AI Gateway
List Gateways
GET/accounts/{account_id}/ai-gateway/gateways
Fetch a Gateway
GET/accounts/{account_id}/ai-gateway/gateways/{id}
Create a new Gateway
POST/accounts/{account_id}/ai-gateway/gateways
Update a Gateway
PUT/accounts/{account_id}/ai-gateway/gateways/{id}
Delete a Gateway
DELETE/accounts/{account_id}/ai-gateway/gateways/{id}
ModelsExpand Collapse
AIGatewayListResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
AIGatewayListResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
byok_only: optional boolean
Requires customer-provided provider credentials and prevents fallback to Unified Billing.
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
guardrails: optional object { prompt, response }
guardrails: optional object { prompt, response }
retry_delay: optional number
Delay between retry attempts in milliseconds (0-60000)
maximum60000
minimum0
retry_max_attempts: optional number
Maximum number of retry attempts for failed requests (1-5)
maximum5
minimum1
spend_limits: optional object { enabled, rules }
spend_limits: optional object { enabled, rules }
AIGatewayGetResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
AIGatewayGetResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
byok_only: optional boolean
Requires customer-provided provider credentials and prevents fallback to Unified Billing.
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
guardrails: optional object { prompt, response }
guardrails: optional object { prompt, response }
retry_delay: optional number
Delay between retry attempts in milliseconds (0-60000)
maximum60000
minimum0
retry_max_attempts: optional number
Maximum number of retry attempts for failed requests (1-5)
maximum5
minimum1
spend_limits: optional object { enabled, rules }
spend_limits: optional object { enabled, rules }
AIGatewayCreateResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
AIGatewayCreateResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
byok_only: optional boolean
Requires customer-provided provider credentials and prevents fallback to Unified Billing.
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
guardrails: optional object { prompt, response }
guardrails: optional object { prompt, response }
retry_delay: optional number
Delay between retry attempts in milliseconds (0-60000)
maximum60000
minimum0
retry_max_attempts: optional number
Maximum number of retry attempts for failed requests (1-5)
maximum5
minimum1
spend_limits: optional object { enabled, rules }
spend_limits: optional object { enabled, rules }
AIGatewayUpdateResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
AIGatewayUpdateResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
byok_only: optional boolean
Requires customer-provided provider credentials and prevents fallback to Unified Billing.
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
guardrails: optional object { prompt, response }
guardrails: optional object { prompt, response }
retry_delay: optional number
Delay between retry attempts in milliseconds (0-60000)
maximum60000
minimum0
retry_max_attempts: optional number
Maximum number of retry attempts for failed requests (1-5)
maximum5
minimum1
spend_limits: optional object { enabled, rules }
spend_limits: optional object { enabled, rules }
AIGatewayDeleteResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
AIGatewayDeleteResponse object { id, cache_invalidate_on_update, cache_ttl, 25 more }
byok_only: optional boolean
Requires customer-provided provider credentials and prevents fallback to Unified Billing.
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
dlp: optional object { action, enabled, profiles } or object { enabled, policies }
guardrails: optional object { prompt, response }
guardrails: optional object { prompt, response }
retry_delay: optional number
Delay between retry attempts in milliseconds (0-60000)
maximum60000
minimum0
retry_max_attempts: optional number
Maximum number of retry attempts for failed requests (1-5)
maximum5
minimum1
spend_limits: optional object { enabled, rules }
spend_limits: optional object { enabled, rules }
AI GatewayEvaluation Types
List Evaluators
GET/accounts/{account_id}/ai-gateway/evaluation-types
AI GatewayCustom Providers
List Account Providers
GET/accounts/{account_id}/ai-gateway/custom-providers
Fetch a Account Provider
GET/accounts/{account_id}/ai-gateway/custom-providers/{id}
Create a new Account Provider
POST/accounts/{account_id}/ai-gateway/custom-providers
Delete a Account Provider
DELETE/accounts/{account_id}/ai-gateway/custom-providers/{id}
ModelsExpand Collapse
AI GatewayLogs
List Gateway Logs
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs
Get Gateway Log Detail
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}
Patch Gateway Log
PATCH/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}
Delete Gateway Logs
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs
Get Gateway Log Request
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}/request
Get Gateway Log Response
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}/response
AI GatewayDatasets
List Datasets
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets
Fetch a Dataset
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets/{id}
Create a new Dataset
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets
Update a Dataset
PUT/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets/{id}
Delete a Dataset
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets/{id}
ModelsExpand Collapse
AI GatewayEvaluations
List Evaluations
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations
Fetch a Evaluation
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations/{id}
Create a new Evaluation
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations
Delete a Evaluation
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations/{id}
ModelsExpand Collapse
EvaluationListResponse object { id, created_at, datasets, 6 more }
EvaluationListResponse object { id, created_at, datasets, 6 more }
EvaluationGetResponse object { id, created_at, datasets, 6 more }
EvaluationGetResponse object { id, created_at, datasets, 6 more }
EvaluationCreateResponse object { id, created_at, datasets, 6 more }
EvaluationCreateResponse object { id, created_at, datasets, 6 more }
EvaluationDeleteResponse object { id, created_at, datasets, 6 more }
EvaluationDeleteResponse object { id, created_at, datasets, 6 more }
AI GatewayDynamic Routing
List all AI Gateway Dynamic Routes.
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes
Get an AI Gateway Dynamic Route.
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}
Create a new AI Gateway Dynamic Route.
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes
Update an AI Gateway Dynamic Route.
PATCH/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}
Delete an AI Gateway Dynamic Route.
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}
List all AI Gateway Dynamic Route Deployments.
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/deployments
Create a new AI Gateway Dynamic Route Deployment.
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/deployments
List all AI Gateway Dynamic Route Versions.
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/versions
Create a new AI Gateway Dynamic Route Version.
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/versions
Get an AI Gateway Dynamic Route Version.
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/versions/{version_id}
ModelsExpand Collapse
DynamicRoutingListResponse object { data, success }
DynamicRoutingListResponse object { data, success }
data: object { order_by, order_by_direction, page, 2 more }
data: object { order_by, order_by_direction, page, 2 more }
routes: array of object { id, account_tag, created_at, 6 more }
routes: array of object { id, account_tag, created_at, 6 more }
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
DynamicRoutingGetResponse object { id, created_at, deployment, 5 more }
DynamicRoutingGetResponse object { id, created_at, deployment, 5 more }
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
DynamicRoutingCreateResponse object { id, created_at, deployment, 5 more }
DynamicRoutingCreateResponse object { id, created_at, deployment, 5 more }
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
DynamicRoutingUpdateResponse object { route, success }
DynamicRoutingUpdateResponse object { route, success }
route: object { id, account_tag, created_at, 6 more }
route: object { id, account_tag, created_at, 6 more }
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
DynamicRoutingDeleteResponse object { id, created_at, elements, 3 more }
DynamicRoutingDeleteResponse object { id, created_at, elements, 3 more }
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
DynamicRoutingCreateDeploymentResponse object { id, created_at, elements, 3 more }
DynamicRoutingCreateDeploymentResponse object { id, created_at, elements, 3 more }
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
DynamicRoutingCreateVersionResponse object { id, created_at, elements, 3 more }
DynamicRoutingCreateVersionResponse object { id, created_at, elements, 3 more }
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
elements: array of object { id, outputs, type } or object { id, outputs, properties, type } or object { id, outputs, type } or 3 more
DynamicRoutingGetVersionResponse object { id, active, created_at, 7 more }
DynamicRoutingGetVersionResponse object { id, active, created_at, 7 more }