Downloads · 30 days
5
4% of all-time downloads
rudrakshrakeshzodage/whisper-large-v3-turbo-ct2-int8
whisper-large-v3-turbo-ct2-int8 is a automatic speech recognition model from rudrakshrakeshzodage. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
This model is an optimized/quantized version of the multilingual Whisper Large-v3-Turbo model supporting 99 languages. It has been benchmarked for both storage footprint and Word Error Rate (ASR accuracy) across 10 ta…
Downloads · 30 days
5
4% of all-time downloads
All-time downloads
124
Public
Repo size
814 MB
Likes
0
Public
Click a slice to open those files.
.bin814 MB · 100%
From the Hugging Face model README
This model is an optimized/quantized version of the multilingual Whisper Large-v3-Turbo model supporting 99 languages. It has been benchmarked for both storage footprint and Word Error Rate (ASR accuracy) across 10 target languages.
[!NOTE] 🌐 Live Web Demo: Try this model directly in your browser without any installation at
huggingface.co/spaces/rudrakshrakeshzodage/neo-whisper
[!NOTE] This model is part of a suite of optimized/quantized versions of the base model. Other variants in this direction:
- PyTorch Q4 (GPU Quantized - NF4):
rudrakshrakeshzodage/whisper-large-v3-turbo-pytorch-q4- CTranslate2 INT8 (CPU Quantized):
rudrakshrakeshzodage/whisper-large-v3-turbo-ct2-int8<span style="color: #3b82f6;">(Current)</span>- Browser ONNX Q4 (WebGPU/Wasm):
rudrakshrakeshzodage/whisper-large-v3-turbo-onnx
Base model: openai/whisper-large-v3-turbo
Quantization: CTranslate2 INT8 CPU Quantization (weights mapped to 8-bit signed integers)
Languages: 99 (all Whisper-supported languages)


| Quantization Format | Target Backend | Target Device | Average WER (%) |
|---|---|---|---|
| CTranslate2 Float32 (CPU) | CTranslate2 | CPU | 45.62% |
| CTranslate2 INT16 (CPU) | CTranslate2 | CPU | 45.96% |
| CTranslate2 INT8 (CPU) | CTranslate2 | CPU | 46.01% |
| PyTorch FP16 (GPU) | PyTorch | GPU | 44.73% |
| PyTorch INT8 (GPU) | PyTorch | GPU | 41.20% |
| PyTorch Q4 (GPU) | PyTorch | GPU | 44.50% |
| Language | PyTorch FP16 (GPU) | PyTorch INT8 (GPU) | PyTorch Q4 (GPU) | CTranslate2 Float32 (CPU) | CTranslate2 INT8 (CPU) | CTranslate2 INT16 (CPU) |
|---|---|---|---|---|---|---|
| English | 63.0% | 63.0% | 63.0% | 69.6% | 69.6% | 69.6% |
| Spanish | 41.1% | 41.1% | 41.1% | 41.1% | 41.1% | 41.1% |
| French | 45.8% | 45.8% | 47.3% | 47.3% | 47.3% | 47.3% |
| Italian | 29.9% | 32.5% | 35.0% | 29.9% | 29.9% | 32.5% |
| German | 18.8% | 18.8% | 22.1% | 18.8% | 18.8% | 18.8% |
| Chinese | 100.0% | 66.7% | 100.0% | 100.0% | 100.0% | 100.0% |
| Korean | 38.2% | 43.0% | 38.2% | 40.8% | 41.8% | 40.8% |
| Dutch | 33.3% | 33.3% | 33.3% | 33.3% | 31.2% | 33.3% |
| Russian | 51.4% | 44.7% | 47.8% | 48.6% | 55.3% | 48.6% |
| Czech | 25.8% | 23.3% | 17.2% | 26.8% | 25.0% | 27.6% |
from faster_whisper import WhisperModel
model_path = "rudrakshrakeshzodage/whisper-large-v3-turbo-ct2-int8"
# Load the model (the compute_type is pre-quantized inside the model folder)
model = WhisperModel(
model_path,
device="cpu"
)
segments, info = model.transcribe("audio.wav", beam_size=1)
for segment in segments:
print(segment.text)
This quantized model suite and performance benchmarks were created by Rudraksh Zodage:
If you find this benchmark helpful, please feel free to star the GitHub repository!