openchat-3.5-0106 Beta

o

openchat-3.5-0106 Beta

Text Generation • openchat • Hosted

@cf/openchat/openchat-3.5-0106

OpenChat is an innovative library of open-source language models, fine-tuned with C-RLFT - a strategy inspired by offline reinforcement learning.

Model Info
Deprecated	10/1/2025
Context Window ↗	8,192 tokens
More information	link ↗
Beta	Yes

Playground

Try out this model with Workers AI LLM Playground. It does not require any setup or authentication and an instant way to preview and test a model directly in the browser.

Launch the LLM Playground

Usage

Worker (Streaming)

TypeScript

export interface Env {
  AI: Ai;
}

export default {
  async fetch(request, env): Promise<Response> {

    const messages = [
      { role: "system", content: "You are a friendly assistant" },
      {
        role: "user",
        content: "What is the origin of the phrase Hello, World",
      },
    ];

    const stream = await env.AI.run("@cf/openchat/openchat-3.5-0106", {
      messages,
      stream: true,
    });

    return new Response(stream, {
      headers: { "content-type": "text/event-stream" },
    });
  },
} satisfies ExportedHandler<Env>;

Explain Code

TypeScript

export interface Env {
  AI: Ai;
}

export default {
  async fetch(request, env): Promise<Response> {

    const messages = [
      { role: "system", content: "You are a friendly assistant" },
      {
        role: "user",
        content: "What is the origin of the phrase Hello, World",
      },
    ];
    const response = await env.AI.run("@cf/openchat/openchat-3.5-0106", { messages });

    return Response.json(response);
  },
} satisfies ExportedHandler<Env>;

Explain Code

Python

import os
import requests

ACCOUNT_ID = "your-account-id"
AUTH_TOKEN = os.environ.get("CLOUDFLARE_AUTH_TOKEN")

prompt = "Tell me all about PEP-8"
response = requests.post(
  f"https://api.cloudflare.com/client/v4/accounts/{ACCOUNT_ID}/ai/run/@cf/openchat/openchat-3.5-0106",
    headers={"Authorization": f"Bearer {AUTH_TOKEN}"},
    json={
      "messages": [
        {"role": "system", "content": "You are a friendly assistant"},
        {"role": "user", "content": prompt}
      ]
    }
)
result = response.json()
print(result)

Explain Code

curl

curl https://api.cloudflare.com/client/v4/accounts/$CLOUDFLARE_ACCOUNT_ID/ai/run/@cf/openchat/openchat-3.5-0106 \
  -X POST \
  -H "Authorization: Bearer $CLOUDFLARE_AUTH_TOKEN" \
  -d '{ "messages": [{ "role": "system", "content": "You are a friendly assistant" }, { "role": "user", "content": "Why is pizza so good" }]}'

OpenAI compatible endpoints

Workers AI also supports OpenAI compatible API endpoints for /v1/chat/completions and /v1/embeddings. For more details, refer to Configurations .

Parameters

Synchronous — Send a request and receive a complete response

Input

prompt

stringrequiredminLength: 1The input text prompt for the model to generate a response.

lora

stringName of the LoRA (Low-Rank Adaptation) model to fine-tune the base model.

▶response_format{}

object

raw

booleandefault: falseIf true, a chat template is not applied and you must adhere to the specific model's expected formatting.

stream

booleandefault: falseIf true, the response will be streamed back incrementally using SSE, Server Sent Events.

max_tokens

integerdefault: 256The maximum number of tokens to generate in the response.

temperature

numberdefault: 0.6minimum: 0maximum: 5Controls the randomness of the output; higher values produce more random results.

top_p

numberminimum: 0.001maximum: 1Adjusts the creativity of the AI's responses by controlling how many possible words it considers. Lower values make outputs more predictable; higher values allow for more varied and creative responses.

top_k

integerminimum: 1maximum: 50Limits the AI to choose from the top 'k' most probable words. Lower values make responses more focused; higher values introduce more variety and potential surprises.

seed

integerminimum: 1maximum: 9999999999Random seed for reproducibility of the generation.

repetition_penalty

numberminimum: 0maximum: 2Penalty for repeated tokens; higher values discourage repetition.

frequency_penalty

numberminimum: -2maximum: 2Decreases the likelihood of the model repeating the same lines verbatim.

presence_penalty

numberminimum: -2maximum: 2Increases the likelihood of the model introducing new topics.

Output

response

stringrequiredThe generated text response from the model

▶usage{}

objectUsage statistics for the inference request

▶tool_calls[]

arrayAn array of tool calls requests made during the response generation

Streaming — Send a request with `stream: true` and receive server-sent events

Input

prompt

stringrequiredminLength: 1The input text prompt for the model to generate a response.

lora

stringName of the LoRA (Low-Rank Adaptation) model to fine-tune the base model.

▶response_format{}

object

raw

booleandefault: falseIf true, a chat template is not applied and you must adhere to the specific model's expected formatting.

stream

booleandefault: falseIf true, the response will be streamed back incrementally using SSE, Server Sent Events.

max_tokens

integerdefault: 256The maximum number of tokens to generate in the response.

temperature

numberdefault: 0.6minimum: 0maximum: 5Controls the randomness of the output; higher values produce more random results.

top_p

numberminimum: 0.001maximum: 1Adjusts the creativity of the AI's responses by controlling how many possible words it considers. Lower values make outputs more predictable; higher values allow for more varied and creative responses.

top_k

integerminimum: 1maximum: 50Limits the AI to choose from the top 'k' most probable words. Lower values make responses more focused; higher values introduce more variety and potential surprises.

seed

integerminimum: 1maximum: 9999999999Random seed for reproducibility of the generation.

repetition_penalty

numberminimum: 0maximum: 2Penalty for repeated tokens; higher values discourage repetition.

frequency_penalty

numberminimum: -2maximum: 2Decreases the likelihood of the model repeating the same lines verbatim.

presence_penalty

numberminimum: -2maximum: 2Increases the likelihood of the model introducing new topics.

Output

type

string

format

binary

API Schemas (Raw)

Synchronous — Send a request and receive a complete response

Input

{
  "title": "Prompt",
  "properties": {
    "prompt": {
      "type": "string",
      "minLength": 1,
      "description": "The input text prompt for the model to generate a response."
    },
    "lora": {
      "type": "string",
      "description": "Name of the LoRA (Low-Rank Adaptation) model to fine-tune the base model."
    },
    "response_format": {
      "title": "JSON Mode",
      "type": "object",
      "properties": {
        "type": {
          "type": "string",
          "enum": [
            "json_object",
            "json_schema"
          ]
        },
        "json_schema": {}
      }
    },
    "raw": {
      "type": "boolean",
      "default": false,
      "description": "If true, a chat template is not applied and you must adhere to the specific model's expected formatting."
    },
    "stream": {
      "type": "boolean",
      "default": false,
      "description": "If true, the response will be streamed back incrementally using SSE, Server Sent Events."
    },
    "max_tokens": {
      "type": "integer",
      "default": 256,
      "description": "The maximum number of tokens to generate in the response."
    },
    "temperature": {
      "type": "number",
      "default": 0.6,
      "minimum": 0,
      "maximum": 5,
      "description": "Controls the randomness of the output; higher values produce more random results."
    },
    "top_p": {
      "type": "number",
      "minimum": 0.001,
      "maximum": 1,
      "description": "Adjusts the creativity of the AI's responses by controlling how many possible words it considers. Lower values make outputs more predictable; higher values allow for more varied and creative responses."
    },
    "top_k": {
      "type": "integer",
      "minimum": 1,
      "maximum": 50,
      "description": "Limits the AI to choose from the top 'k' most probable words. Lower values make responses more focused; higher values introduce more variety and potential surprises."
    },
    "seed": {
      "type": "integer",
      "minimum": 1,
      "maximum": 9999999999,
      "description": "Random seed for reproducibility of the generation."
    },
    "repetition_penalty": {
      "type": "number",
      "minimum": 0,
      "maximum": 2,
      "description": "Penalty for repeated tokens; higher values discourage repetition."
    },
    "frequency_penalty": {
      "type": "number",
      "minimum": -2,
      "maximum": 2,
      "description": "Decreases the likelihood of the model repeating the same lines verbatim."
    },
    "presence_penalty": {
      "type": "number",
      "minimum": -2,
      "maximum": 2,
      "description": "Increases the likelihood of the model introducing new topics."
    }
  },
  "required": [
    "prompt"
  ]
}

Explain Code

Output

{
  "type": "object",
  "properties": {
    "response": {
      "type": "string",
      "description": "The generated text response from the model"
    },
    "usage": {
      "type": "object",
      "description": "Usage statistics for the inference request",
      "properties": {
        "prompt_tokens": {
          "type": "number",
          "description": "Total number of tokens in input",
          "default": 0
        },
        "completion_tokens": {
          "type": "number",
          "description": "Total number of tokens in output",
          "default": 0
        },
        "total_tokens": {
          "type": "number",
          "description": "Total number of input and output tokens",
          "default": 0
        }
      }
    },
    "tool_calls": {
      "type": "array",
      "description": "An array of tool calls requests made during the response generation",
      "items": {
        "type": "object",
        "properties": {
          "arguments": {
            "type": "object",
            "description": "The arguments passed to be passed to the tool call request"
          },
          "name": {
            "type": "string",
            "description": "The name of the tool to be called"
          }
        }
      }
    }
  },
  "required": [
    "response"
  ]
}

Explain Code

Streaming — Send a request with `stream: true` and receive server-sent events

Input

{
  "title": "Prompt",
  "properties": {
    "prompt": {
      "type": "string",
      "minLength": 1,
      "description": "The input text prompt for the model to generate a response."
    },
    "lora": {
      "type": "string",
      "description": "Name of the LoRA (Low-Rank Adaptation) model to fine-tune the base model."
    },
    "response_format": {
      "title": "JSON Mode",
      "type": "object",
      "properties": {
        "type": {
          "type": "string",
          "enum": [
            "json_object",
            "json_schema"
          ]
        },
        "json_schema": {}
      }
    },
    "raw": {
      "type": "boolean",
      "default": false,
      "description": "If true, a chat template is not applied and you must adhere to the specific model's expected formatting."
    },
    "stream": {
      "type": "boolean",
      "default": false,
      "description": "If true, the response will be streamed back incrementally using SSE, Server Sent Events."
    },
    "max_tokens": {
      "type": "integer",
      "default": 256,
      "description": "The maximum number of tokens to generate in the response."
    },
    "temperature": {
      "type": "number",
      "default": 0.6,
      "minimum": 0,
      "maximum": 5,
      "description": "Controls the randomness of the output; higher values produce more random results."
    },
    "top_p": {
      "type": "number",
      "minimum": 0.001,
      "maximum": 1,
      "description": "Adjusts the creativity of the AI's responses by controlling how many possible words it considers. Lower values make outputs more predictable; higher values allow for more varied and creative responses."
    },
    "top_k": {
      "type": "integer",
      "minimum": 1,
      "maximum": 50,
      "description": "Limits the AI to choose from the top 'k' most probable words. Lower values make responses more focused; higher values introduce more variety and potential surprises."
    },
    "seed": {
      "type": "integer",
      "minimum": 1,
      "maximum": 9999999999,
      "description": "Random seed for reproducibility of the generation."
    },
    "repetition_penalty": {
      "type": "number",
      "minimum": 0,
      "maximum": 2,
      "description": "Penalty for repeated tokens; higher values discourage repetition."
    },
    "frequency_penalty": {
      "type": "number",
      "minimum": -2,
      "maximum": 2,
      "description": "Decreases the likelihood of the model repeating the same lines verbatim."
    },
    "presence_penalty": {
      "type": "number",
      "minimum": -2,
      "maximum": 2,
      "description": "Increases the likelihood of the model introducing new topics."
    }
  },
  "required": [
    "prompt"
  ]
}

Explain Code

Output

{
  "type": "string",
  "format": "binary"
}