whisper-medium.en

whisper-medium.en

ONNX builds of openai/whisper-medium.en.

Whisper is OpenAI's automatic speech recognition model. This checkpoint is English-only: it was trained on the English subset, which makes it more accurate on English than the multilingual checkpoint of the same size, and unusable on anything else.

It reads audio in 30-second windows and decodes text one token at a time, and produces segment-level timestamps.

This checkpoint: 769 M parameters — close to large accuracy at half the size.

Variants

Every variant is the same checkpoint at a different weight precision. Pick a row, download that folder, and read onnx_manifest.json in it for the graph names and their checksums.

fp32 is not published for this checkpoint — it is the source format, available from the original repository. It is used above as the reference the other rows are measured against.

Word error rate measured on ten minutes of English speech against a hand-checked transcript, greedy decoding, no voice-activity detection. It is a single corpus in a single language: use it to compare the rows against each other, not as an absolute score.

What the names mean

• fp16 — Half-precision encoder, full-precision decoder. Smaller than fp32 and slower on CPU, where no float16 kernel exists — useful on GPU.
• plain-int8 — 8-bit weights, nothing excluded.
• plain-int4 — 4-bit weights, nothing excluded. Usually the smallest that still works.
• sym-int4-asym — 4-bit weights with an asymmetric scale, which does not assume the weights are centred on zero.
• zone-int4-attn — 4-bit weights, with the attention projections kept at 8 bits.

The int4 variants are meant for the CPU. On ONNX Runtime's CUDA provider the 4-bit matrix kernel (MatMulNBits) loses precision above 128 rows, which covers every encoder pass.

Licence

These are format conversions. The weights, and the licence they come with, are those of the original checkpoint — see the source repository.