Changelog
We’ve updated how cache keys are calculated. As a result, new cache entries will be created, and you may experience more cache misses than usual during this transition. Please monitor your traffic and performance, and let us know if you encounter any issues.
Added WebSockets API to provide a persistent connection for AI interactions, eliminating repeated handshakes and reducing latency.
Added Guardrails help deploy AI applications safely by intercepting and evaluating both user prompts and model responses for harmful content.
Introduced customizable log storage settings, enabling users to:
- Define the maximum number of logs stored per gateway.
- Choose how logs are handled when the storage limit is reached:
- On - Automatically delete the oldest logs to ensure new logs are always saved.
- Off - Stop saving new logs when the storage limit is reached.
- Added request handling options to help manage AI provider interactions effectively, ensuring your applications remain responsive and reliable.
- Configuration: Added ElevenLabs, Cartesia, and Cerebras as new providers.
- Configuration: Added DeepSeek as a new provider.
- Updated dashboard to view performance, costs, and stats across all gateways.
- Bug Fixes: Fixed Anthropic errors being cached.
- Bug Fixes: Fixed
env.AI.run()requests using authenticated gateways returning authentication error.
- Configuration: Added OpenRouter as a new provider.
- Configuration: Added WebSockets API which provides a single persistent connection, enabling continuous communication.
- Configuration: Added Authentication which adds security by requiring a valid authorization token for each request.
- Providers: Added Grok as a new provider.
Added Vercel AI SDK. The SDK supports many different AI providers, tools for streaming completions, and more.
- Logs: AI Gateway now has logs that persist, giving you the flexibility to store them for your preferred duration.
- Logs: Securely export logs to an external storage location using Logpush.
- Pricing: Added pricing for storing logs persistently.
- Configurations: Use AI Gateway’s Evaluations to make informed decisions on how to optimize your AI application.
- Configuration: AI Gateway now allows you to set custom costs at the request level custom costs to requests, accurately reflect your unique pricing, overriding the default or public model costs.
- Providers: Added Mistral AI as a new provider.
- Providers: Added Google AI Studio as a new provider.
AI Gateway now supports adding custom metadata to requests, improving tracking and analysis of incoming requests.
Logs are now available for the last 24 hours.
AI Gateway now supports custom cache key headers.
Workers AI now natively supports AI Gateway.
- Added new endpoints to the REST API.
- LLM Side Channel vulnerability fixed
- Providers: Added Anthropic, Google Vertex, Perplexity as providers.
- Real-time Logs: Logs are now real-time, showing logs for the last hour. If you have a need for persistent logs, please let the team know on Discord. We are building out a persistent logs feature for those who want to store their logs for longer.
- Providers: Azure OpenAI is now supported as a provider!
- Docs: Added Azure OpenAI example.
- Bug Fixes: Errors with costs and tokens should be fixed.
- Logs: Logs will now be limited to the last 24h. If you have a use case that requires more logging, please reach out to the team on Discord.
- Dashboard: Logs now refresh automatically.
- Docs: Fixed Workers AI example in docs and dash.
- Caching: Embedding requests are now cacheable. Rate limit will not apply for cached requests.
- Bug Fixes: Identical requests to different providers are not wrongly served from cache anymore. Streaming now works as expected, including for the Universal endpoint.
- Known Issues: There's currently a bug with costs that we are investigating.
Was this helpful?
- Resources
- API
- New to Cloudflare?
- Products
- Sponsorships
- Open Source
- Support
- Help Center
- System Status
- Compliance
- GDPR
- Company
- cloudflare.com
- Our team
- Careers
- 2025 Cloudflare, Inc.
- Privacy Policy
- Terms of Use
- Report Security Issues
- Trademark