Downloads · 30 days
4
8% of all-time downloads
kostasang/whisper-large-v3-turbo-onnx-fp16
whisper-large-v3-turbo-onnx-fp16 is a machine learning model from kostasang. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for optimum.
This is a FP16 ONNX version of openai/whisper-large-v3-turbo.
Downloads · 30 days
4
8% of all-time downloads
All-time downloads
53
Public
Repo size
2.2 GB
Likes
0
Public
Click a slice to open those files.
.onnx2.2 GB · 100%
From the Hugging Face model README
This is a FP16 ONNX version of openai/whisper-large-v3-turbo.
| Version | Size |
|---|---|
| Base ONNX (FP32) | 4198.51 MB |
| FP16 ONNX | 2099.54 MB ← |
| INT8 Quantized ONNX | 1459.58 MB |
| Compression | 2.00x |
from optimum.onnxruntime import ORTModelForSpeechSeq2Seq
from transformers import AutoProcessor
model = ORTModelForSpeechSeq2Seq.from_pretrained("kostasang/whisper-large-v3-turbo-onnx-fp16")
processor = AutoProcessor.from_pretrained("kostasang/whisper-large-v3-turbo-onnx-fp16")