Skip to content
Cloudflare API
Start here
API Reference

AI Gateway

List gateways
client.aiGateway.list(AIGatewayListParams { account_id, page, per_page, search } params, RequestOptionsoptions?): V4PagePaginationArray<AIGatewayListResponse { id, cache_invalidate_on_update, cache_ttl, 25 more } >
GET/accounts/{account_id}/ai-gateway/gateways
Get a gateway
client.aiGateway.get(stringid, AIGatewayGetParams { account_id } params, RequestOptionsoptions?): AIGatewayGetResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
GET/accounts/{account_id}/ai-gateway/gateways/{id}
Create a gateway
client.aiGateway.create(AIGatewayCreateParams { account_id, id, cache_invalidate_on_update, 23 more } params, RequestOptionsoptions?): AIGatewayCreateResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
POST/accounts/{account_id}/ai-gateway/gateways
Update a gateway
client.aiGateway.update(stringid, AIGatewayUpdateParams { account_id, cache_invalidate_on_update, cache_ttl, 22 more } params, RequestOptionsoptions?): AIGatewayUpdateResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
PUT/accounts/{account_id}/ai-gateway/gateways/{id}
Delete a gateway
client.aiGateway.delete(stringid, AIGatewayDeleteParams { account_id } params, RequestOptionsoptions?): AIGatewayDeleteResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
DELETE/accounts/{account_id}/ai-gateway/gateways/{id}
ModelsExpand Collapse
AIGatewayListResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
cache_invalidate_on_update: boolean
cache_ttl: number | null
minimum0
collect_logs: boolean
created_at: string
formatdate-time
modified_at: string
formatdate-time
rate_limiting_interval: number | null
minimum0
rate_limiting_limit: number | null
minimum0
authentication?: boolean
byok_only?: boolean

Requires customer-provided provider credentials and prevents fallback to Unified Billing.

dlp?: UnionMember0 { action, enabled, profiles } | UnionMember1 { enabled, policies }
One of the following:
UnionMember0 { action, enabled, profiles }
action: "BLOCK" | "FLAG"
One of the following:
"BLOCK"
"FLAG"
enabled: boolean
profiles: Array<string>
UnionMember1 { enabled, policies }
enabled: boolean
policies: Array<Policy>
id: string
action: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
check: Array<"REQUEST" | "RESPONSE">
One of the following:
"REQUEST"
"RESPONSE"
enabled: boolean
profiles: Array<string>
guardrails?: Guardrails | null
prompt: Prompt { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
response: Response { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
is_default?: boolean
log_classification?: boolean
log_management?: number | null
maximum10000000
minimum10000
log_management_strategy?: "STOP_INSERTING" | "DELETE_OLDEST" | null
One of the following:
"STOP_INSERTING"
"DELETE_OLDEST"
logpush?: boolean
logpush_public_key?: string | null
maxLength1024
minLength16
otel?: Array<Otel> | null
headers: Record<string, string>
url: string
formaturi
maxLength2048
authorization?: string
maxLength256
content_type?: "json" | "protobuf"
One of the following:
"json"
"protobuf"
rate_limiting_technique?: "fixed" | "sliding" | null
One of the following:
"fixed"
"sliding"
retry_backoff?: "constant" | "linear" | "exponential" | null

Backoff strategy for retry delays

One of the following:
"constant"
"linear"
"exponential"
retry_delay?: number | null

Delay between retry attempts in milliseconds (0-60000)

maximum60000
minimum0
retry_max_attempts?: number | null

Maximum number of retry attempts for failed requests (1-5)

maximum5
minimum1
spend_limits?: SpendLimits | null
enabled?: boolean
rules?: Array<Rule>
limit: number
exclusiveMinimum
minimum0
limitType: "cost"
window: number
exclusiveMinimum
minimum0
id?: string
minLength1
enabled?: boolean
metadata?: Record<string, Mode { mode } | UnionMember1 { mode, values } >
One of the following:
Mode { mode }
mode: "partition"
UnionMember1 { mode, values }
mode: "filter"
values: Array<string>
model?: Model { mode, values }
mode: "filter"
values: Array<string>
provider?: Provider { mode, values }
mode: "filter"
values: Array<string>
technique?: "fixed" | "sliding"
One of the following:
"fixed"
"sliding"
store_id?: string | null
stripe?: Stripe | null
authorization: string
usage_events: Array<UsageEvent>
payload: string
workers_ai_billing_mode?: "postpaid" | "unified"

Controls how Workers AI inference calls routed through this gateway are billed. ‘postpaid’ bills the account directly through Workers AI; ‘unified’ deducts credits via AI Gateway using neuron-based pricing and delegates billing to AI Gateway.

One of the following:
"postpaid"
"unified"
zdr?: boolean
AIGatewayGetResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
cache_invalidate_on_update: boolean
cache_ttl: number | null
minimum0
collect_logs: boolean
created_at: string
formatdate-time
modified_at: string
formatdate-time
rate_limiting_interval: number | null
minimum0
rate_limiting_limit: number | null
minimum0
authentication?: boolean
byok_only?: boolean

Requires customer-provided provider credentials and prevents fallback to Unified Billing.

dlp?: UnionMember0 { action, enabled, profiles } | UnionMember1 { enabled, policies }
One of the following:
UnionMember0 { action, enabled, profiles }
action: "BLOCK" | "FLAG"
One of the following:
"BLOCK"
"FLAG"
enabled: boolean
profiles: Array<string>
UnionMember1 { enabled, policies }
enabled: boolean
policies: Array<Policy>
id: string
action: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
check: Array<"REQUEST" | "RESPONSE">
One of the following:
"REQUEST"
"RESPONSE"
enabled: boolean
profiles: Array<string>
guardrails?: Guardrails | null
prompt: Prompt { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
response: Response { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
is_default?: boolean
log_classification?: boolean
log_management?: number | null
maximum10000000
minimum10000
log_management_strategy?: "STOP_INSERTING" | "DELETE_OLDEST" | null
One of the following:
"STOP_INSERTING"
"DELETE_OLDEST"
logpush?: boolean
logpush_public_key?: string | null
maxLength1024
minLength16
otel?: Array<Otel> | null
headers: Record<string, string>
url: string
formaturi
maxLength2048
authorization?: string
maxLength256
content_type?: "json" | "protobuf"
One of the following:
"json"
"protobuf"
rate_limiting_technique?: "fixed" | "sliding" | null
One of the following:
"fixed"
"sliding"
retry_backoff?: "constant" | "linear" | "exponential" | null

Backoff strategy for retry delays

One of the following:
"constant"
"linear"
"exponential"
retry_delay?: number | null

Delay between retry attempts in milliseconds (0-60000)

maximum60000
minimum0
retry_max_attempts?: number | null

Maximum number of retry attempts for failed requests (1-5)

maximum5
minimum1
spend_limits?: SpendLimits | null
enabled?: boolean
rules?: Array<Rule>
limit: number
exclusiveMinimum
minimum0
limitType: "cost"
window: number
exclusiveMinimum
minimum0
id?: string
minLength1
enabled?: boolean
metadata?: Record<string, Mode { mode } | UnionMember1 { mode, values } >
One of the following:
Mode { mode }
mode: "partition"
UnionMember1 { mode, values }
mode: "filter"
values: Array<string>
model?: Model { mode, values }
mode: "filter"
values: Array<string>
provider?: Provider { mode, values }
mode: "filter"
values: Array<string>
technique?: "fixed" | "sliding"
One of the following:
"fixed"
"sliding"
store_id?: string | null
stripe?: Stripe | null
authorization: string
usage_events: Array<UsageEvent>
payload: string
workers_ai_billing_mode?: "postpaid" | "unified"

Controls how Workers AI inference calls routed through this gateway are billed. ‘postpaid’ bills the account directly through Workers AI; ‘unified’ deducts credits via AI Gateway using neuron-based pricing and delegates billing to AI Gateway.

One of the following:
"postpaid"
"unified"
zdr?: boolean
AIGatewayCreateResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
cache_invalidate_on_update: boolean
cache_ttl: number | null
minimum0
collect_logs: boolean
created_at: string
formatdate-time
modified_at: string
formatdate-time
rate_limiting_interval: number | null
minimum0
rate_limiting_limit: number | null
minimum0
authentication?: boolean
byok_only?: boolean

Requires customer-provided provider credentials and prevents fallback to Unified Billing.

dlp?: UnionMember0 { action, enabled, profiles } | UnionMember1 { enabled, policies }
One of the following:
UnionMember0 { action, enabled, profiles }
action: "BLOCK" | "FLAG"
One of the following:
"BLOCK"
"FLAG"
enabled: boolean
profiles: Array<string>
UnionMember1 { enabled, policies }
enabled: boolean
policies: Array<Policy>
id: string
action: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
check: Array<"REQUEST" | "RESPONSE">
One of the following:
"REQUEST"
"RESPONSE"
enabled: boolean
profiles: Array<string>
guardrails?: Guardrails | null
prompt: Prompt { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
response: Response { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
is_default?: boolean
log_classification?: boolean
log_management?: number | null
maximum10000000
minimum10000
log_management_strategy?: "STOP_INSERTING" | "DELETE_OLDEST" | null
One of the following:
"STOP_INSERTING"
"DELETE_OLDEST"
logpush?: boolean
logpush_public_key?: string | null
maxLength1024
minLength16
otel?: Array<Otel> | null
headers: Record<string, string>
url: string
formaturi
maxLength2048
authorization?: string
maxLength256
content_type?: "json" | "protobuf"
One of the following:
"json"
"protobuf"
rate_limiting_technique?: "fixed" | "sliding" | null
One of the following:
"fixed"
"sliding"
retry_backoff?: "constant" | "linear" | "exponential" | null

Backoff strategy for retry delays

One of the following:
"constant"
"linear"
"exponential"
retry_delay?: number | null

Delay between retry attempts in milliseconds (0-60000)

maximum60000
minimum0
retry_max_attempts?: number | null

Maximum number of retry attempts for failed requests (1-5)

maximum5
minimum1
spend_limits?: SpendLimits | null
enabled?: boolean
rules?: Array<Rule>
limit: number
exclusiveMinimum
minimum0
limitType: "cost"
window: number
exclusiveMinimum
minimum0
id?: string
minLength1
enabled?: boolean
metadata?: Record<string, Mode { mode } | UnionMember1 { mode, values } >
One of the following:
Mode { mode }
mode: "partition"
UnionMember1 { mode, values }
mode: "filter"
values: Array<string>
model?: Model { mode, values }
mode: "filter"
values: Array<string>
provider?: Provider { mode, values }
mode: "filter"
values: Array<string>
technique?: "fixed" | "sliding"
One of the following:
"fixed"
"sliding"
store_id?: string | null
stripe?: Stripe | null
authorization: string
usage_events: Array<UsageEvent>
payload: string
workers_ai_billing_mode?: "postpaid" | "unified"

Controls how Workers AI inference calls routed through this gateway are billed. ‘postpaid’ bills the account directly through Workers AI; ‘unified’ deducts credits via AI Gateway using neuron-based pricing and delegates billing to AI Gateway.

One of the following:
"postpaid"
"unified"
zdr?: boolean
AIGatewayUpdateResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
cache_invalidate_on_update: boolean
cache_ttl: number | null
minimum0
collect_logs: boolean
created_at: string
formatdate-time
modified_at: string
formatdate-time
rate_limiting_interval: number | null
minimum0
rate_limiting_limit: number | null
minimum0
authentication?: boolean
byok_only?: boolean

Requires customer-provided provider credentials and prevents fallback to Unified Billing.

dlp?: UnionMember0 { action, enabled, profiles } | UnionMember1 { enabled, policies }
One of the following:
UnionMember0 { action, enabled, profiles }
action: "BLOCK" | "FLAG"
One of the following:
"BLOCK"
"FLAG"
enabled: boolean
profiles: Array<string>
UnionMember1 { enabled, policies }
enabled: boolean
policies: Array<Policy>
id: string
action: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
check: Array<"REQUEST" | "RESPONSE">
One of the following:
"REQUEST"
"RESPONSE"
enabled: boolean
profiles: Array<string>
guardrails?: Guardrails | null
prompt: Prompt { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
response: Response { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
is_default?: boolean
log_classification?: boolean
log_management?: number | null
maximum10000000
minimum10000
log_management_strategy?: "STOP_INSERTING" | "DELETE_OLDEST" | null
One of the following:
"STOP_INSERTING"
"DELETE_OLDEST"
logpush?: boolean
logpush_public_key?: string | null
maxLength1024
minLength16
otel?: Array<Otel> | null
headers: Record<string, string>
url: string
formaturi
maxLength2048
authorization?: string
maxLength256
content_type?: "json" | "protobuf"
One of the following:
"json"
"protobuf"
rate_limiting_technique?: "fixed" | "sliding" | null
One of the following:
"fixed"
"sliding"
retry_backoff?: "constant" | "linear" | "exponential" | null

Backoff strategy for retry delays

One of the following:
"constant"
"linear"
"exponential"
retry_delay?: number | null

Delay between retry attempts in milliseconds (0-60000)

maximum60000
minimum0
retry_max_attempts?: number | null

Maximum number of retry attempts for failed requests (1-5)

maximum5
minimum1
spend_limits?: SpendLimits | null
enabled?: boolean
rules?: Array<Rule>
limit: number
exclusiveMinimum
minimum0
limitType: "cost"
window: number
exclusiveMinimum
minimum0
id?: string
minLength1
enabled?: boolean
metadata?: Record<string, Mode { mode } | UnionMember1 { mode, values } >
One of the following:
Mode { mode }
mode: "partition"
UnionMember1 { mode, values }
mode: "filter"
values: Array<string>
model?: Model { mode, values }
mode: "filter"
values: Array<string>
provider?: Provider { mode, values }
mode: "filter"
values: Array<string>
technique?: "fixed" | "sliding"
One of the following:
"fixed"
"sliding"
store_id?: string | null
stripe?: Stripe | null
authorization: string
usage_events: Array<UsageEvent>
payload: string
workers_ai_billing_mode?: "postpaid" | "unified"

Controls how Workers AI inference calls routed through this gateway are billed. ‘postpaid’ bills the account directly through Workers AI; ‘unified’ deducts credits via AI Gateway using neuron-based pricing and delegates billing to AI Gateway.

One of the following:
"postpaid"
"unified"
zdr?: boolean
AIGatewayDeleteResponse { id, cache_invalidate_on_update, cache_ttl, 25 more }
id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
cache_invalidate_on_update: boolean
cache_ttl: number | null
minimum0
collect_logs: boolean
created_at: string
formatdate-time
modified_at: string
formatdate-time
rate_limiting_interval: number | null
minimum0
rate_limiting_limit: number | null
minimum0
authentication?: boolean
byok_only?: boolean

Requires customer-provided provider credentials and prevents fallback to Unified Billing.

dlp?: UnionMember0 { action, enabled, profiles } | UnionMember1 { enabled, policies }
One of the following:
UnionMember0 { action, enabled, profiles }
action: "BLOCK" | "FLAG"
One of the following:
"BLOCK"
"FLAG"
enabled: boolean
profiles: Array<string>
UnionMember1 { enabled, policies }
enabled: boolean
policies: Array<Policy>
id: string
action: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
check: Array<"REQUEST" | "RESPONSE">
One of the following:
"REQUEST"
"RESPONSE"
enabled: boolean
profiles: Array<string>
guardrails?: Guardrails | null
prompt: Prompt { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
response: Response { P1, S1, S10, 11 more }
P1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S1?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S10?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S11?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S12?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S13?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S2?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S3?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S4?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S5?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S6?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S7?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S8?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
S9?: "FLAG" | "BLOCK"
One of the following:
"FLAG"
"BLOCK"
is_default?: boolean
log_classification?: boolean
log_management?: number | null
maximum10000000
minimum10000
log_management_strategy?: "STOP_INSERTING" | "DELETE_OLDEST" | null
One of the following:
"STOP_INSERTING"
"DELETE_OLDEST"
logpush?: boolean
logpush_public_key?: string | null
maxLength1024
minLength16
otel?: Array<Otel> | null
headers: Record<string, string>
url: string
formaturi
maxLength2048
authorization?: string
maxLength256
content_type?: "json" | "protobuf"
One of the following:
"json"
"protobuf"
rate_limiting_technique?: "fixed" | "sliding" | null
One of the following:
"fixed"
"sliding"
retry_backoff?: "constant" | "linear" | "exponential" | null

Backoff strategy for retry delays

One of the following:
"constant"
"linear"
"exponential"
retry_delay?: number | null

Delay between retry attempts in milliseconds (0-60000)

maximum60000
minimum0
retry_max_attempts?: number | null

Maximum number of retry attempts for failed requests (1-5)

maximum5
minimum1
spend_limits?: SpendLimits | null
enabled?: boolean
rules?: Array<Rule>
limit: number
exclusiveMinimum
minimum0
limitType: "cost"
window: number
exclusiveMinimum
minimum0
id?: string
minLength1
enabled?: boolean
metadata?: Record<string, Mode { mode } | UnionMember1 { mode, values } >
One of the following:
Mode { mode }
mode: "partition"
UnionMember1 { mode, values }
mode: "filter"
values: Array<string>
model?: Model { mode, values }
mode: "filter"
values: Array<string>
provider?: Provider { mode, values }
mode: "filter"
values: Array<string>
technique?: "fixed" | "sliding"
One of the following:
"fixed"
"sliding"
store_id?: string | null
stripe?: Stripe | null
authorization: string
usage_events: Array<UsageEvent>
payload: string
workers_ai_billing_mode?: "postpaid" | "unified"

Controls how Workers AI inference calls routed through this gateway are billed. ‘postpaid’ bills the account directly through Workers AI; ‘unified’ deducts credits via AI Gateway using neuron-based pricing and delegates billing to AI Gateway.

One of the following:
"postpaid"
"unified"
zdr?: boolean

AI GatewayEvaluation Types

List evaluator types (deprecated)
client.aiGateway.evaluationTypes.list(EvaluationTypeListParams { account_id, order_by, order_by_direction, 2 more } params, RequestOptionsoptions?): V4PagePaginationArray<EvaluationTypeListResponse { id, created_at, description, 5 more } >
GET/accounts/{account_id}/ai-gateway/evaluation-types
ModelsExpand Collapse
EvaluationTypeListResponse { id, created_at, description, 5 more }
id: string
created_at: string
formatdate-time
description: string
enable: boolean
mandatory: boolean
modified_at: string
formatdate-time
name: string
type: string

AI GatewayCustom Providers

List custom providers
client.aiGateway.customProviders.list(CustomProviderListParams { account_id, beta, enable, 3 more } params, RequestOptionsoptions?): V4PagePaginationArray<CustomProviderListResponse { id, base_url, created_at, 12 more } >
GET/accounts/{account_id}/ai-gateway/custom-providers
Get a custom provider
client.aiGateway.customProviders.get(stringid, CustomProviderGetParams { account_id } params, RequestOptionsoptions?): CustomProviderGetResponse { id, base_url, created_at, 12 more }
GET/accounts/{account_id}/ai-gateway/custom-providers/{id}
Create a custom provider
client.aiGateway.customProviders.create(CustomProviderCreateParams { account_id, base_url, name, 9 more } params, RequestOptionsoptions?): CustomProviderCreateResponse { id, base_url, created_at, 12 more }
POST/accounts/{account_id}/ai-gateway/custom-providers
Delete a custom provider
client.aiGateway.customProviders.delete(stringid, CustomProviderDeleteParams { account_id } params, RequestOptionsoptions?): CustomProviderDeleteResponse { id, base_url, created_at, 12 more }
DELETE/accounts/{account_id}/ai-gateway/custom-providers/{id}
ModelsExpand Collapse
CustomProviderListResponse { id, base_url, created_at, 12 more }
id: string
formatuuid
base_url: string
formaturi
created_at: string
formatdate-time
modified_at: string
formatdate-time
name: string
slug: string
beta?: boolean
curl_example?: string
description?: string
enable?: boolean
headers?: string

JSON object of extra HTTP headers that AI Gateway sends to the provider. Values can contain credentials.

maxLength8192
js_example?: string
position?: number
CustomProviderGetResponse { id, base_url, created_at, 12 more }
id: string
formatuuid
base_url: string
formaturi
created_at: string
formatdate-time
modified_at: string
formatdate-time
name: string
slug: string
beta?: boolean
curl_example?: string
description?: string
enable?: boolean
headers?: string

JSON object of extra HTTP headers that AI Gateway sends to the provider. Values can contain credentials.

maxLength8192
js_example?: string
position?: number
CustomProviderCreateResponse { id, base_url, created_at, 12 more }
id: string
formatuuid
base_url: string
formaturi
created_at: string
formatdate-time
modified_at: string
formatdate-time
name: string
slug: string
beta?: boolean
curl_example?: string
description?: string
enable?: boolean
headers?: string

JSON object of extra HTTP headers that AI Gateway sends to the provider. Values can contain credentials.

maxLength8192
js_example?: string
position?: number
CustomProviderDeleteResponse { id, base_url, created_at, 12 more }
id: string
formatuuid
base_url: string
formaturi
created_at: string
formatdate-time
modified_at: string
formatdate-time
name: string
slug: string
beta?: boolean
curl_example?: string
description?: string
enable?: boolean
headers?: string

JSON object of extra HTTP headers that AI Gateway sends to the provider. Values can contain credentials.

maxLength8192
js_example?: string
position?: number

AI GatewayLogs

List Gateway Logs
client.aiGateway.logs.list(stringgatewayID, LogListParams { account_id, cached, direction, 26 more } params, RequestOptionsoptions?): V4PagePaginationArray<LogListResponse { id, cached, created_at, 16 more } >
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs
Get Gateway Log Detail
client.aiGateway.logs.get(stringid, LogGetParams { account_id, gateway_id } params, RequestOptionsoptions?): LogGetResponse { id, cached, created_at, 22 more }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}
Patch Gateway Log
client.aiGateway.logs.edit(stringid, LogEditParams { account_id, gateway_id, feedback, 2 more } params, RequestOptionsoptions?): LogEditResponse
PATCH/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}
Delete Gateway Logs
client.aiGateway.logs.delete(stringgatewayID, LogDeleteParams { account_id, filters, limit, 2 more } params, RequestOptionsoptions?): LogDeleteResponse { success }
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs
Get Gateway Log Request
client.aiGateway.logs.request(stringid, LogRequestParams { account_id, gateway_id } params, RequestOptionsoptions?): LogRequestResponse
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}/request
Get Gateway Log Response
client.aiGateway.logs.response(stringid, LogResponseParams { account_id, gateway_id } params, RequestOptionsoptions?): LogResponseResponse
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/logs/{id}/response
ModelsExpand Collapse
LogListResponse { id, cached, created_at, 16 more }
id: string
cached: boolean
created_at: string
formatdate-time
duration: number
model: string
path: string
provider: string
success: boolean
tokens_in: number | null
tokens_out: number | null
cost?: number
custom_cost?: boolean
metadata?: string
model_type?: string
request_content_type?: string
request_type?: string
response_content_type?: string
status_code?: number
step?: number
LogGetResponse { id, cached, created_at, 22 more }
id: string
cached: boolean
created_at: string
formatdate-time
duration: number
model: string
path: string
provider: string
success: boolean
tokens_in: number | null
tokens_out: number | null
cost?: number
custom_cost?: boolean
metadata?: string
model_type?: string
request_content_type?: string
request_head?: string
request_head_complete?: boolean
request_size?: number
request_type?: string
response_content_type?: string
response_head?: string
response_head_complete?: boolean
response_size?: number
status_code?: number
step?: number
LogEditResponse = unknown
LogDeleteResponse { success }
success: boolean
LogRequestResponse = unknown
LogResponseResponse = unknown

AI GatewayDatasets

List datasets (deprecated)
client.aiGateway.datasets.list(stringgatewayID, DatasetListParams { account_id, enable, name, 3 more } params, RequestOptionsoptions?): V4PagePaginationArray<DatasetListResponse { id, created_at, enable, 4 more } >
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets
Get a dataset (deprecated)
client.aiGateway.datasets.get(stringid, DatasetGetParams { account_id, gateway_id } params, RequestOptionsoptions?): DatasetGetResponse { id, created_at, enable, 4 more }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets/{id}
Create a dataset (deprecated)
client.aiGateway.datasets.create(stringgatewayID, DatasetCreateParams { account_id, enable, filters, name } params, RequestOptionsoptions?): DatasetCreateResponse { id, created_at, enable, 4 more }
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets
Update a dataset (deprecated)
client.aiGateway.datasets.update(stringid, DatasetUpdateParams { account_id, gateway_id, enable, 2 more } params, RequestOptionsoptions?): DatasetUpdateResponse { id, created_at, enable, 4 more }
PUT/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets/{id}
Delete a dataset (deprecated)
client.aiGateway.datasets.delete(stringid, DatasetDeleteParams { account_id, gateway_id } params, RequestOptionsoptions?): DatasetDeleteResponse { id, created_at, enable, 4 more }
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/datasets/{id}
ModelsExpand Collapse
DatasetListResponse { id, created_at, enable, 4 more }
id: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
DatasetGetResponse { id, created_at, enable, 4 more }
id: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
DatasetCreateResponse { id, created_at, enable, 4 more }
id: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
DatasetUpdateResponse { id, created_at, enable, 4 more }
id: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
DatasetDeleteResponse { id, created_at, enable, 4 more }
id: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string

AI GatewayEvaluations

List evaluations (deprecated)
client.aiGateway.evaluations.list(stringgatewayID, EvaluationListParams { account_id, name, page, 3 more } params, RequestOptionsoptions?): V4PagePaginationArray<EvaluationListResponse { id, created_at, datasets, 6 more } >
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations
Get an evaluation (deprecated)
client.aiGateway.evaluations.get(stringid, EvaluationGetParams { account_id, gateway_id } params, RequestOptionsoptions?): EvaluationGetResponse { id, created_at, datasets, 6 more }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations/{id}
Create an evaluation (deprecated)
client.aiGateway.evaluations.create(stringgatewayID, EvaluationCreateParams { account_id, dataset_ids, evaluation_type_ids, name } params, RequestOptionsoptions?): EvaluationCreateResponse { id, created_at, datasets, 6 more }
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations
Delete an evaluation (deprecated)
client.aiGateway.evaluations.delete(stringid, EvaluationDeleteParams { account_id, gateway_id } params, RequestOptionsoptions?): EvaluationDeleteResponse { id, created_at, datasets, 6 more }
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/evaluations/{id}
ModelsExpand Collapse
EvaluationListResponse { id, created_at, datasets, 6 more }
id: string
created_at: string
formatdate-time
datasets: Array<Dataset>
id: string
account_id: string
account_tag: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
processed: boolean
results: Array<Result>
id: string
created_at: string
formatdate-time
evaluation_id: string
evaluation_type_id: string
modified_at: string
formatdate-time
result: string
status: number
status_description: string
total_logs: number
total_logs: number
EvaluationGetResponse { id, created_at, datasets, 6 more }
id: string
created_at: string
formatdate-time
datasets: Array<Dataset>
id: string
account_id: string
account_tag: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
processed: boolean
results: Array<Result>
id: string
created_at: string
formatdate-time
evaluation_id: string
evaluation_type_id: string
modified_at: string
formatdate-time
result: string
status: number
status_description: string
total_logs: number
total_logs: number
EvaluationCreateResponse { id, created_at, datasets, 6 more }
id: string
created_at: string
formatdate-time
datasets: Array<Dataset>
id: string
account_id: string
account_tag: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
processed: boolean
results: Array<Result>
id: string
created_at: string
formatdate-time
evaluation_id: string
evaluation_type_id: string
modified_at: string
formatdate-time
result: string
status: number
status_description: string
total_logs: number
total_logs: number
EvaluationDeleteResponse { id, created_at, datasets, 6 more }
id: string
created_at: string
formatdate-time
datasets: Array<Dataset>
id: string
account_id: string
account_tag: string
created_at: string
formatdate-time
enable: boolean
filters: Array<Filter>
key: "created_at" | "request_content_type" | "response_content_type" | 10 more
One of the following:
"created_at"
"request_content_type"
"response_content_type"
"success"
"cached"
"provider"
"model"
"cost"
"tokens"
"tokens_in"
"tokens_out"
"duration"
"feedback"
operator: "eq" | "contains" | "lt" | "gt"
One of the following:
"eq"
"contains"
"lt"
"gt"
value: Array<string | number | boolean>
One of the following:
string
number
boolean
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
gateway_id: string

Unique identifier of the AI Gateway within the account.

maxLength64
minLength1
modified_at: string
formatdate-time
name: string
processed: boolean
results: Array<Result>
id: string
created_at: string
formatdate-time
evaluation_id: string
evaluation_type_id: string
modified_at: string
formatdate-time
result: string
status: number
status_description: string
total_logs: number
total_logs: number

AI GatewayDynamic Routing

List dynamic routes
client.aiGateway.dynamicRouting.list(stringgatewayID, DynamicRoutingListParams { account_id, page, per_page } params, RequestOptionsoptions?): DynamicRoutingListResponse { data, success }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes
Get a dynamic route
client.aiGateway.dynamicRouting.get(stringid, DynamicRoutingGetParams { account_id, gateway_id } params, RequestOptionsoptions?): DynamicRoutingGetResponse { id, created_at, deployment, 5 more }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}
Create a dynamic route
client.aiGateway.dynamicRouting.create(stringgatewayID, DynamicRoutingCreateParams { account_id, elements, name } params, RequestOptionsoptions?): DynamicRoutingCreateResponse { id, created_at, deployment, 5 more }
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes
Rename a dynamic route
client.aiGateway.dynamicRouting.update(stringid, DynamicRoutingUpdateParams { account_id, gateway_id, name } params, RequestOptionsoptions?): DynamicRoutingUpdateResponse { route, success }
PATCH/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}
Delete a dynamic route
client.aiGateway.dynamicRouting.delete(stringid, DynamicRoutingDeleteParams { account_id, gateway_id } params, RequestOptionsoptions?): DynamicRoutingDeleteResponse { id, created_at, elements, 3 more }
DELETE/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}
List dynamic route deployments
client.aiGateway.dynamicRouting.listDeployments(stringid, DynamicRoutingListDeploymentsParams { account_id, gateway_id } params, RequestOptionsoptions?): DynamicRoutingListDeploymentsResponse { data, success }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/deployments
Deploy a dynamic route version
client.aiGateway.dynamicRouting.createDeployment(stringid, DynamicRoutingCreateDeploymentParams { account_id, gateway_id, version_id } params, RequestOptionsoptions?): DynamicRoutingCreateDeploymentResponse { id, created_at, elements, 3 more }
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/deployments
List dynamic route versions
client.aiGateway.dynamicRouting.listVersions(stringid, DynamicRoutingListVersionsParams { account_id, gateway_id } params, RequestOptionsoptions?): DynamicRoutingListVersionsResponse { data, success }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/versions
Create a dynamic route version
client.aiGateway.dynamicRouting.createVersion(stringid, DynamicRoutingCreateVersionParams { account_id, gateway_id, elements } params, RequestOptionsoptions?): DynamicRoutingCreateVersionResponse { id, created_at, elements, 3 more }
POST/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/versions
Get a dynamic route version
client.aiGateway.dynamicRouting.getVersion(stringversionID, DynamicRoutingGetVersionParams { account_id, gateway_id, id } params, RequestOptionsoptions?): DynamicRoutingGetVersionResponse { id, active, created_at, 7 more }
GET/accounts/{account_id}/ai-gateway/gateways/{gateway_id}/routes/{id}/versions/{version_id}
ModelsExpand Collapse
DynamicRoutingListResponse { data, success }
data: Data { order_by, order_by_direction, page, 2 more }
order_by: string
order_by_direction: string
page: number
per_page: number
routes: Array<Route>
id: string
account_tag: string
created_at: string
formatdate-time
deployment: Deployment { created_at, deployment_id, version_id }
created_at: string
deployment_id: string
version_id: string
elements: Array<UnionMember0 { id, outputs, type } | UnionMember1 { id, outputs, properties, type } | UnionMember2 { id, outputs, type } | 3 more>
One of the following:
UnionMember0 { id, outputs, type }
id: string
outputs: Outputs { next }
type: "start"
UnionMember1 { id, outputs, properties, type }
id: string
outputs: Outputs { false, true }
false: False { elementId }
elementId: string
true: True { elementId }
elementId: string
properties: Properties { conditions }
conditions?: unknown
type: "conditional"
UnionMember2 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "percentage"
UnionMember3 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { key, limit, limitType, window }
key: string
limit: number
limitType: "count" | "cost"
One of the following:
"count"
"cost"
window: number
type: "rate"
UnionMember4 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { model, provider, retries, timeout }
model: string
provider: string
retries: number
timeout: number
type: "model"
UnionMember5 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "end"
gateway_id: string
modified_at: string
formatdate-time
name: string
minLength1
version: Version { active, created_at, data, 2 more }
active: "true" | "false"
One of the following:
"true"
"false"
created_at: string
data: string
version_id: string
is_valid?: boolean
success: boolean
DynamicRoutingGetResponse { id, created_at, deployment, 5 more }
id: string
created_at: string
formatdate-time
deployment: Deployment { created_at, deployment_id, version_id }
created_at: string
deployment_id: string
version_id: string
elements: Array<UnionMember0 { id, outputs, type } | UnionMember1 { id, outputs, properties, type } | UnionMember2 { id, outputs, type } | 3 more>
One of the following:
UnionMember0 { id, outputs, type }
id: string
outputs: Outputs { next }
type: "start"
UnionMember1 { id, outputs, properties, type }
id: string
outputs: Outputs { false, true }
false: False { elementId }
elementId: string
true: True { elementId }
elementId: string
properties: Properties { conditions }
conditions?: unknown
type: "conditional"
UnionMember2 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "percentage"
UnionMember3 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { key, limit, limitType, window }
key: string
limit: number
limitType: "count" | "cost"
One of the following:
"count"
"cost"
window: number
type: "rate"
UnionMember4 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { model, provider, retries, timeout }
model: string
provider: string
retries: number
timeout: number
type: "model"
UnionMember5 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "end"
gateway_id: string
modified_at: string
formatdate-time
name: string
minLength1
version: Version { active, created_at, data, 2 more }
active: "true" | "false"
One of the following:
"true"
"false"
created_at: string
data: string
version_id: string
is_valid?: boolean
DynamicRoutingCreateResponse { id, created_at, deployment, 5 more }
id: string
created_at: string
formatdate-time
deployment: Deployment { created_at, deployment_id, version_id }
created_at: string
deployment_id: string
version_id: string
elements: Array<UnionMember0 { id, outputs, type } | UnionMember1 { id, outputs, properties, type } | UnionMember2 { id, outputs, type } | 3 more>
One of the following:
UnionMember0 { id, outputs, type }
id: string
outputs: Outputs { next }
type: "start"
UnionMember1 { id, outputs, properties, type }
id: string
outputs: Outputs { false, true }
false: False { elementId }
elementId: string
true: True { elementId }
elementId: string
properties: Properties { conditions }
conditions?: unknown
type: "conditional"
UnionMember2 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "percentage"
UnionMember3 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { key, limit, limitType, window }
key: string
limit: number
limitType: "count" | "cost"
One of the following:
"count"
"cost"
window: number
type: "rate"
UnionMember4 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { model, provider, retries, timeout }
model: string
provider: string
retries: number
timeout: number
type: "model"
UnionMember5 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "end"
gateway_id: string
modified_at: string
formatdate-time
name: string
minLength1
version: Version { active, created_at, data, 2 more }
active: "true" | "false"
One of the following:
"true"
"false"
created_at: string
data: string
version_id: string
is_valid?: boolean
DynamicRoutingUpdateResponse { route, success }
route: Route { id, account_tag, created_at, 6 more }
id: string
account_tag: string
created_at: string
formatdate-time
deployment: Deployment { created_at, deployment_id, version_id }
created_at: string
deployment_id: string
version_id: string
elements: Array<UnionMember0 { id, outputs, type } | UnionMember1 { id, outputs, properties, type } | UnionMember2 { id, outputs, type } | 3 more>
One of the following:
UnionMember0 { id, outputs, type }
id: string
outputs: Outputs { next }
type: "start"
UnionMember1 { id, outputs, properties, type }
id: string
outputs: Outputs { false, true }
false: False { elementId }
elementId: string
true: True { elementId }
elementId: string
properties: Properties { conditions }
conditions?: unknown
type: "conditional"
UnionMember2 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "percentage"
UnionMember3 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { key, limit, limitType, window }
key: string
limit: number
limitType: "count" | "cost"
One of the following:
"count"
"cost"
window: number
type: "rate"
UnionMember4 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { model, provider, retries, timeout }
model: string
provider: string
retries: number
timeout: number
type: "model"
UnionMember5 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "end"
gateway_id: string
modified_at: string
formatdate-time
name: string
minLength1
version: Version { active, created_at, data, 2 more }
active: "true" | "false"
One of the following:
"true"
"false"
created_at: string
data: string
version_id: string
is_valid?: boolean
success: boolean
DynamicRoutingDeleteResponse { id, created_at, elements, 3 more }
id: string
created_at: string
formatdate-time
elements: Array<UnionMember0 { id, outputs, type } | UnionMember1 { id, outputs, properties, type } | UnionMember2 { id, outputs, type } | 3 more>
One of the following:
UnionMember0 { id, outputs, type }
id: string
outputs: Outputs { next }
type: "start"
UnionMember1 { id, outputs, properties, type }
id: string
outputs: Outputs { false, true }
false: False { elementId }
elementId: string
true: True { elementId }
elementId: string
properties: Properties { conditions }
conditions?: unknown
type: "conditional"
UnionMember2 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "percentage"
UnionMember3 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { key, limit, limitType, window }
key: string
limit: number
limitType: "count" | "cost"
One of the following:
"count"
"cost"
window: number
type: "rate"
UnionMember4 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { model, provider, retries, timeout }
model: string
provider: string
retries: number
timeout: number
type: "model"
UnionMember5 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "end"
gateway_id: string
modified_at: string
formatdate-time
name: string
minLength1
DynamicRoutingListDeploymentsResponse { data, success }
data: Data { deployments, order_by, order_by_direction, 2 more }
deployments: Array<Deployment>
created_at: string
deployment_id: string
version_id: string
order_by: string
order_by_direction: string
page: number
per_page: number
success: boolean
DynamicRoutingCreateDeploymentResponse { id, created_at, elements, 3 more }
id: string
created_at: string
formatdate-time
elements: Array<UnionMember0 { id, outputs, type } | UnionMember1 { id, outputs, properties, type } | UnionMember2 { id, outputs, type } | 3 more>
One of the following:
UnionMember0 { id, outputs, type }
id: string
outputs: Outputs { next }
type: "start"
UnionMember1 { id, outputs, properties, type }
id: string
outputs: Outputs { false, true }
false: False { elementId }
elementId: string
true: True { elementId }
elementId: string
properties: Properties { conditions }
conditions?: unknown
type: "conditional"
UnionMember2 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "percentage"
UnionMember3 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { key, limit, limitType, window }
key: string
limit: number
limitType: "count" | "cost"
One of the following:
"count"
"cost"
window: number
type: "rate"
UnionMember4 { id, outputs, properties, type }
id: string
outputs: Outputs { fallback, success }
fallback: Fallback { elementId }
elementId: string
success: Success { elementId }
elementId: string
properties: Properties { model, provider, retries, timeout }
model: string
provider: string
retries: number
timeout: number
type: "model"
UnionMember5 { id, outputs, type }
id: string
outputs: Record<string, Outputs>
elementId: string
type: "end"
gateway_id: string
modified_at: string
formatdate-time
name: string
minLength1
DynamicRoutingListVersionsResponse { data, success }
data: Data { order_by, order_by_direction, page, 2 more }
order_by: string
order_by_direction: string
page: number
per_page: number
versions: Array<Version>
active: "true" | "false"
One of the following:
"true"
"false"
created_at: string
data: string
version_id: string
is_valid?: boolean
success: boolean
DynamicRoutingCreateVersionResponse { id, created_at, elements, 3 more }
id: string
created_at: string
formatdate-time
elements: Array<UnionMember0 { id, outputs, type } | UnionMember1 { id, outputs, properties, type } | UnionMember2 { id, outputs, type } | 3 more>
One of the following:
UnionMember0 { id, outputs, type }
id: string
outputs: Outputs { next }
type: "start"
UnionMember1 { id, outputs, properties, type }
id: string
outputs: Outputs { false, true }
false: False { elementId }
elementId: string
true: True { elementId }
elementId: string
properties: Properties { conditions }
conditions?: unknown
type: "conditional"