Skip to main content

API Gateway overview

The API Gateway publishes internal workloads—agents, functions, serverless container services, vector databases, Pub/Sub channels, and MemoryStore instances—to secure internet endpoints.

Core capabilities

An endpoint is an internet-facing gateway route pointing to a project resource. Endpoints decouple public access policies (authentication, domain names, rate limits, IP allowlists) from underlying workload runtime behavior.

Endpoint components

ComponentFunctionDefault Setting
NameEndpoint identifier and default URL hostname prefix.Required
TargetInternal workload or data service receiving traffic.Required
DomainPublic hostname (platform-provided domain or custom domain).Platform domain (*.apps.codyhill.dev)
AuthenticationCaller identity verification (none, jwt, apikey).none (Open)
IP AllowlistCIDR network restriction rules.Unrestricted
Rate LimitRequest ceiling per caller per time window.Unrestricted

Publishable target types

You can publish endpoints for the following resource types:

  • Agents (agent): Wakes automatically from scale-to-zero on inbound requests.
  • Functions (function): Serverless event-driven execution.
  • Serverless Services (serverless or container): Scalable containerized API services.
  • Vector Database (vectordb): Managed vector database HTTP API.
  • Pub/Sub (pubsub): Project messaging broker endpoint.
  • MemoryStore (memorystore): In-memory key-value data instance.
Scale-to-Zero Integration

Publishing an agent, function, or serverless service through the Gateway preserves scale-to-zero behavior. Inbound requests to an idle workload automatically wake up instances to process traffic.

Protection modes

API Gateway provides three distinct authentication modes:

  • Open (none): Publicly accessible endpoint without edge credential checks. Useful for public endpoints, documentation sites, or webhooks verified in application code.
  • JSON Web Tokens (jwt): Edge validation for standard OIDC / OAuth2 tokens issued by your identity provider (e.g. Auth0, Okta).
  • API Keys (apikey): Gateway-issued API keys sent in the X-API-Key header with automatic expiration, rotation, and usage tracking.

Feature comparison

FeatureCrusoe AI Platform API GatewayCloud Provider Gateways
Deployment ModelDirect one-click publishingMulti-step API / Stage / Deployment setup
Authentication OptionsNative Open, OIDC JWT, or Gateway API KeysIAM, Cognito, Custom Authorizers, API Keys
Network SecurityNative CIDR IP allowlistsNetwork ACLs / WAF integrations
Traffic ThrottlingBuilt-in per-caller rate limitingUsage plans and throttling tiers
Custom DomainsAutomatic TLS certificate provisioningCustom domain mappings and certificate imports

Next steps