Costs
AI Gateway currently supports cost metrics from the following providers:
- Anthropic
- Azure OpenAI
- Cohere
- Google AI Studio
- Groq
- Mistral
- OpenAI
- Perplexity
- Replicate
Cost metrics are only available for endpoints where the models return token data and the model name in their responses.
AI Gateway allows users to set custom costs when operating under special pricing agreements or negotiated rates. Custom costs can be applied at the request level, and when applied, they will override the default or public model costs. For more information on configuration of custom costs, please visit the Custom Costs configuration page.