Skip to content
Cloudflare Docs
Docs DirectoryAPIsSDKs

Bring your own generation model

When using AI Search, AI Search uses a Workers AI model to generate the response. If you want to use a model outside of Workers AI, you can use AI Search for search while using a different model to generate responses.

This example uses an OpenAI model to generate responses from AI Search results. It uses the Workers binding.

JavaScript
import { openai } from "@ai-sdk/openai";
import { generateText } from "ai";


export default {
  async fetch(request, env) {
    const url = new URL(request.url);


    const userQuery = url.searchParams.get("query") ?? "What is Cloudflare?";


    // Search for documents in AI Search
    const searchResult = await env.AI_SEARCH.get("my-instance").search({
      messages: [{ role: "user", content: userQuery }],
    });


    if (searchResult.chunks.length === 0) {
      return Response.json({ text: `No data found for query "${userQuery}"` });
    }


    // Join all document chunks into a single string
    const chunks = searchResult.chunks
      .map((chunk) => {
        return `<file name="${chunk.item.key}">${chunk.text}</file>`;
      })
      .join("\n\n");


    // Send the user query + matched documents to OpenAI for answer
    const generateResult = await generateText({
      model: openai("gpt-4o-mini"),
      messages: [
        {
          role: "system",
          content:
            "You are a helpful assistant and your task is to answer the user question using the provided files.",
        },
        { role: "user", content: chunks },
        { role: "user", content: userQuery },
      ],
    });


    return Response.json({ text: generateResult.text });
  },
};