Cloudflare Docs
Workers AI
Edit this page
Report an issue with this page
Log into the Cloudflare dashboard
Set theme to dark (⇧+D)

Hugging Face Chat UI

Use Workers AI with Chat UI, an open-source chat interface offered by Hugging Face.

​​ Prerequisites

You will need the following:

​​ Setup

First, decide how to reference your Account ID and API token (either directly in your .env.local using the CLOUDFLARE_ACCOUNT_ID and CLOUDFLARE_API_TOKEN variables or in the endpoint configuration).

Then, follow the rest of the setup instructions in the Chat UI GitHub repository.

When setting up your models, specify the cloudflare endpoint.

"name" : "nousresearch/hermes-2-pro-mistral-7b",
"tokenizer": "nousresearch/hermes-2-pro-mistral-7b",
"parameters": {
"stop": ["<|im_end|>"]
"endpoints" : [
"type": "cloudflare",
// optionally specify these if not included in .env.local
"accountId": "your-account-id",
"apiToken": "your-api-token"

​​ Supported models

This template works with any text generation models that begin with the @hf parameter.