Skip to content
Cloudflare Docs

whisper-tiny-en Beta

Automatic Speech Recognition • OpenAI
@cf/openai/whisper-tiny-en

Whisper is a pre-trained model for automatic speech recognition (ASR) and speech translation. Trained on 680k hours of labelled data, Whisper models demonstrate a strong ability to generalize to many datasets and domains without the need for fine-tuning. This is the English-only version of the Whisper Tiny model which was trained on the task of speech recognition.

    Usage

    Workers - TypeScript

     
    export interface Env {
      AI: Ai;
    }
    

    export default {
      async fetch(request, env): Promise<Response> {
        const res = await fetch(
          "https://github.com/Azure-Samples/cognitive-services-speech-sdk/raw/master/samples/cpp/windows/console/samples/enrollment_audio_katie.wav"
        );
        const blob = await res.arrayBuffer();
    

        const input = {
          audio: [...new Uint8Array(blob)],
        };
    

        const response = await env.AI.run(
          "@cf/openai/whisper-tiny-en",
          input
        );
    

        return Response.json({ input: { audio: [] }, response });
      },
    } satisfies ExportedHandler<Env>;

    curl
    Terminal window
    curl https://api.cloudflare.com/client/v4/accounts/$CLOUDFLARE_ACCOUNT_ID/ai/run/@cf/openai/whisper-tiny-en  \
      -X POST  \
      -H "Authorization: Bearer $CLOUDFLARE_API_TOKEN"  \
      --data-binary "@talking-llama.mp3"

    Parameters

    Input

    • 0 string

    • 1 object

      • audio array

        An array of integers that represent the audio data constrained to 8-bit unsigned integer values

        • items number

          A value between 0 and 255

      • source_lang string

        The language of the recorded audio

      • target_lang string

        The language to translate the transcription into. Currently only English is supported.

    Output

    • text string

      The transcription

    • word_count number

    • words array

      • items object

        • word string

        • start number

          The second this word begins in the recording

        • end number

          The ending second when the word completes

    • vtt string

    API Schemas

    The following schemas are based on JSON Schema

    {
        "oneOf": [
            {
                "type": "string",
                "format": "binary"
            },
            {
                "type": "object",
                "properties": {
                    "audio": {
                        "type": "array",
                        "description": "An array of integers that represent the audio data constrained to 8-bit unsigned integer values",
                        "items": {
                            "type": "number",
                            "description": "A value between 0 and 255"
                        }
                    },
                    "source_lang": {
                        "type": "string",
                        "description": "The language of the recorded audio"
                    },
                    "target_lang": {
                        "type": "string",
                        "description": "The language to translate the transcription into. Currently only English is supported."
                    }
                },
                "required": [
                    "audio"
                ]
            }
        ]
    }
    Cloudflare DashboardDiscordCommunityLearning CenterSupport Portal
    Cookie Settings