Skip to main content

API Gateway overview

The API Gateway publishes internal workloads—agents, functions, serverless services, container apps, MCP servers, the vector database, Pub/Sub, and MemoryStore instances—to secure internet endpoints.

It is the only way a resource on this platform gets an address on the internet. One publishing path means one place your access policy lives and one audit trail, rather than a per-product switch each with its own idea of what "exposed" means.

Core capabilities​

An endpoint is an internet-facing gateway route pointing to a project resource. Endpoints decouple public access policies (authentication, domain names, rate limits, IP allowlists) from underlying workload runtime behavior.

Endpoint components​

ComponentFunctionDefault Setting
NameEndpoint identifier and default URL hostname prefix.Required
TargetInternal workload or data service receiving traffic.Required
DomainPublic hostname (platform-provided domain or custom domain).Platform domain (*.apps.codyhill.net)
AuthenticationCaller identity verification (none, jwt, apikey).none (Open)
IP AllowlistCIDR network restriction rules.Unrestricted
Rate LimitRequest ceiling per caller per time window.Unrestricted

Publishable target types​

ResourceTargetTakes a name?How it is reached
AgentagentyesWeb requests
FunctionfunctionyesWeb requests
Serverless serviceserverlessyesWeb requests
Container appcontaineryesWeb requests
MCP servermcpyesWeb requests
Vector databasevectordbno — covers the whole projectWeb requests
Pub/Subpubsubno — covers the whole projectRaw connection
MemoryStorememorystoreyesRaw connection

What you can publish has a section per type: the exact command, the protections that type supports, and the one thing about it that catches people out.

Scale-to-zero keeps working

Publishing an agent, function, serverless service, container app or MCP server preserves scale-to-zero. An inbound request to an idle workload wakes an instance and waits for it, so a published address does not oblige you to keep anything warm.

A raw connection cannot check a credential

Pub/Sub and MemoryStore speak their own binary protocols, so there are no requests for the gateway to read. An authentication mode or a rate limit on one of those would be a protection that does not exist, and the API refuses both rather than accepting them and doing nothing. Address allow lists still work, and the service's own credential is what lets a caller in.

Protection modes​

API Gateway provides three distinct authentication modes:

  • Open (none): Publicly accessible endpoint without edge credential checks. Useful for public endpoints, documentation sites, or webhooks verified in application code.
  • JSON Web Tokens (jwt): Edge validation for standard OIDC / OAuth2 tokens issued by your identity provider (e.g. Auth0, Okta).
  • API Keys (apikey): Gateway-issued API keys sent in the X-API-Key header with automatic expiration, rotation, and usage tracking.

Feature comparison​

FeatureCrusoe AI Platform API GatewayCloud Provider Gateways
Deployment ModelDirect one-click publishingMulti-step API / Stage / Deployment setup
Authentication OptionsNative Open, OIDC JWT, or Gateway API KeysIAM, Cognito, Custom Authorizers, API Keys
Network SecurityNative CIDR IP allowlistsNetwork ACLs / WAF integrations
Traffic ThrottlingBuilt-in per-caller rate limitingUsage plans and throttling tiers
Custom DomainsAutomatic TLS certificate provisioningCustom domain mappings and certificate imports

Next steps​