Downloads · 30 days
13
16% of all-time downloads
kostasang/whisper-large-v3-turbo-onnx-int8
whisper-large-v3-turbo-onnx-int8 is a machine learning model from kostasang. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for optimum.
This is a INT8 Quantized ONNX version of openai/whisper-large-v3-turbo.
Downloads · 30 days
13
16% of all-time downloads
All-time downloads
80
Public
Repo size
3.1 GB
Likes
0
Public
Click a slice to open those files.
.onnx1.5 GB · 100%
From the Hugging Face model README
This is a INT8 Quantized ONNX version of openai/whisper-large-v3-turbo.
| Version | Size |
|---|---|
| Base ONNX (FP32) | 4198.51 MB |
| FP16 ONNX | 2099.54 MB |
| INT8 Quantized ONNX | 1459.58 MB ← |
| Compression | 2.88x |
from optimum.onnxruntime import ORTModelForSpeechSeq2Seq
from transformers import AutoProcessor
model = ORTModelForSpeechSeq2Seq.from_pretrained("kostasang/whisper-large-v3-turbo-onnx-int8")
processor = AutoProcessor.from_pretrained("kostasang/whisper-large-v3-turbo-onnx-int8")
This model was quantized using dynamic INT8 quantization with ONNX Runtime.