Skip to content
Cloudflare Docs

OpenAI

OpenAI ↗ helps you build with ChatGPT.

Endpoint

https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/openai

URL structure

When making requests to OpenAI, replace https://api.openai.com/v1 in the URL you’re currently using with https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/openai.

Prerequisites

When making requests to OpenAI, ensure you have the following:

  • Your AI Gateway Account ID.
  • Your AI Gateway gateway name.
  • An active OpenAI API token.
  • The name of the OpenAI model you want to use.

Examples

cURL

Request
curl https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/openai/chat/completions \
  --header 'Authorization: Bearer {openai_token}' \
  --header 'Content-Type: application/json' \
  --data ' {
        "model": "gpt-4o-mini",
        "messages": [
        {
          "role": "user",
          "content": "What is Cloudflare"
        }
        ]
      }
'

Use OpenAI SDK with JavaScript

If you are using a library like openai-node, set the baseURL to your OpenAI endpoint like this:

JavaScript
import OpenAI from "openai";


const apiKey = "my api key"; // defaults to process.env["OPENAI_API_KEY"]
const accountId = "{account_id}";
const gatewayId = "{gateway_id}";
const baseURL = `https://gateway.ai.cloudflare.com/v1/${accountId}/${gatewayId}/openai`;


const openai = new OpenAI({
  apiKey,
  baseURL,
});


try {
  const model = "gpt-3.5-turbo-0613";
  const messages = [{ role: "user", content: "What is a neuron?" }];
  const maxTokens = 100;


  const chatCompletion = await openai.chat.completions.create({
    model,
    messages,
    max_tokens: maxTokens,
  });


  const response = chatCompletion.choices[0].message;


  return new Response(JSON.stringify(response));
} catch (e) {
  return new Response(e);
}