Skip to main content

Concept parity — core cloud patterns mapped

This guide maps universal cloud infrastructure patterns—regardless of vendor-specific product branding—directly to Crusoe AI Platform services. Use this concept reference to understand how core architectural building blocks operate on our platform.

Core Cloud Concepts Matrix

Infrastructure ConceptOperational DefinitionCrusoe AI Platform ServiceDocumentation
Virtual MachinesOn-demand compute instances running custom softwareDeploy containers natively as Serverless Services without managing host operating systemsDeploy a Service
Autoscaling GroupsAutomated capacity scaling based on incoming request loadBuilt-in Autoscaling on all workloads—idle workloads pause and wake on requestAutoscaling & Scale-to-Zero
Load BalancerTraffic distributor providing public entrypoints and SSLEvery workload has a canonical address, https://<name>-<project-short>.apps.codyhill.dev, that is not reachable from the public internet until you publish it through the gateway; publishing also handles the certificatePublish an Endpoint
API GatewayManaged front door providing rate limiting and authenticationGateway endpoints for publishing, securing, and rate-limiting APIsPublish an Endpoint
Serverless FunctionsOn-demand event-driven code executionFunctions: handle(event) entrypoints exposed via HTTPSFunction Quickstart
Object StorageS3-compatible cloud bucket storage for unstructured filesS3-compatible buckets provided via Crusoe Cloud IntegrationObject Storage
Storage Event TriggersCode run over new objects, delivered on a pollobjectstore Triggers POST the object's own bytes as the request body — not an event record. Non-JSON content reaches a Python handler as {"data": "<text>"}; CloudEvent attributes are exposed under event["_cloudevent"] and on this source do not carry the object key. Delivery is by polling (poll_seconds, default 60), so it is not instantObjectStore Triggers
Queue ServiceAsynchronous message queuing between producers and consumersPub/Sub topics and subscriptions supporting point-to-point queue processingPub/Sub Quickstart
Notification Fan-outOne-to-many messaging broadcasting events to subscribersPub/Sub Topics with independent subscriber queues tracking positionsTopics & Subscriptions
Event RoutingEvent filtering and target delivery based on message rulesPub/Sub Messaging and workload TriggersTriggers
NoSQL Key-Value StoreLow-latency in-memory data store for state and cachingMemoryStore: fully managed key-value store that speaks the Redis wire protocol, so any Redis client worksMemoryStore Quickstart
Vector SearchSemantic similarity search over high-dimensional embeddingsVectorDB: dedicated HNSW vector indexing with payload filteringVectorDB Quickstart
Secrets ServiceEncrypted, write-only credentials managementSecrets Manager: write-only secrets injected directly as environment variablesManage Secrets
Identity & Access ManagementRole-based permission policies for users and workloadsProject-scoped admin and member roles plus Service Accounts for machinesProjects & Access
Audit TrailImmutable security audit logging of management operationsPer-project Audit Log enabled by default for all member actionsAudit Logs
Log Search & MetricsMetrics collection and log aggregationReal-time metric counters and 14-day persistent Logs streamingTroubleshooting
Network IsolationIsolated network boundaries between tenant workloadsProject-level network isolation blocking unauthorized cross-project accessWorkload Networking
Encryption / Key ManagementPlatform-wide data encryption in transit and at restAutomated AES-256 platform encryption at rest and TLS 1.3 encryption in transitData Protection
Workflow OrchestrationCoordinating multi-step distributed tasks across servicesEvent-driven Pub/Sub message chains, AI agent tool pipelines, or external webhooksAgent Tools and Pub/Sub
Container RegistryImage storage and management for containerized workloadsIntegrated container image storage managed per workload upon deploymentCrusoe Cloud Integration
Infrastructure as CodeRepeatable declarative resource managementDeclarative execution via platformctl CLI scripts and REST API endpointsCLI Reference
Machine CI IdentityScoped machine credentials for automated pipelinesService Account API keys with instant revocationCI/CD Tutorial

Multi-Step Orchestration Patterns

Building multi-step distributed applications on Crusoe AI Platform is straightforward. Four primary architectural patterns handle complex multi-step workflows:

  1. Pub/Sub Queue Chains: Break multi-step jobs into independent processing steps. Each step executes its work, then publishes a message to a Pub/Sub topic triggering the next step. If a worker fails, Pub/Sub redelivers the message automatically.
  2. AI Agent Tool Pipelines: Use an Agent to orchestrate multi-step tasks dynamically. The agent uses native Tools to invoke external services and manages execution state via built-in Sessions.
  3. Stateful Checkpointing: Store step progress in MemoryStore after each task. If a process restarts, the next step reads the latest checkpoint from MemoryStore and continues processing.
  4. External Orchestrator Webhooks: Trigger platform functions or services via HTTPS webhooks from external workflow engines when integrating with existing enterprise control planes.

Advantages of Unified Agent & Serverless Architecture

Traditional clouds force developers to stitch together separate services, configure API gateways, manage IAM policy documents, and coordinate multiple billing line items.

Crusoe AI Platform simplifies this by unifying AI Agents, Serverless Compute, Pub/Sub Messaging, VectorDB, and MemoryStore into a single cohesive project environment:

  • One-Command Publishing: Workloads are private when they land; putting one on the internet is a single command with an explicit auth choice (platformctl gateway publish function/hello-http --auth none), with no proxy to run and no certificate to request.
  • Built-In AI Agent State: AI agents include automatic session history and long-term memory out of the box—no separate database configuration required.
  • Single Developer Toolchain: Manage all compute, agent, messaging, and storage resources using a single CLI (platformctl) and unified web console.
  • Predictable Resource Management: Capacity is bounded by real-time project quotas, providing transparent operational visibility across all workloads.

Next Steps