Cloudflare Docs
AI Gateway
Edit this page on GitHub
Set theme to dark (⇧+D)

Azure OpenAI

When making requests to Azure OpenAI, you will need:

  • AI Gateway account tag
  • AI Gateway gateway name
  • Azure OpenAI API key
  • Azure OpenAI resource name
  • Azure OpenAI deployment name (aka model name)

Your new base URL will use the data above in this structure: Then, you can append your endpoint and api-version at the end of the base URL, like .../chat/completions?api-version=2023-05-15.

Example fetch request
curl --request POST \
--url '' \
--header 'Content-Type: application/json' \
--header 'api-key: KEY' \
--data '{
"messages": [
"role": "system",
"content": "You are a helpful assistant."
"role": "user",
"content": "What is Cloudflare?"

If you are using the openai-node library, you can set your endpoint like this:

import OpenAI from "openai";
const resource = 'xxx'; //without the
const model = 'xxx';
const apiVersion = 'xxx';
const apiKey = env.AZURE_OPENAI_API_KEY;
const azure_openai = new OpenAI({
baseURL: `${resource}/${model}`,
defaultQuery: { 'api-version': apiVersion },
defaultHeaders: { 'api-key': apiKey },