whisper-small-uz-onnx-int8

whisper-small · INT8 ONNX — Uzbek Speech Recognition

ONNX export of Saidakbar01/whisper-small-uz-finetuned, a Whisper-small model fine-tuned for the Uzbek language.

Quantized with INT8 dynamic quantization (AutoQuantizationConfig.avx2, is_static=False, per_channel=False).

Model Details

Files

• encoder_model_quantized.onnx
• decoder_model_quantized.onnx
• decoder_with_past_model_quantized.onnx

Usage

from optimum.onnxruntime import ORTModelForSpeechSeq2Seq
from transformers import WhisperProcessor
import torch

# Load processor and ONNX model
processor = WhisperProcessor.from_pretrained(
    "openai/whisper-small",
    language="uz",
    task="transcribe",
)
model = ORTModelForSpeechSeq2Seq.from_pretrained(
    "Saidakbar01/whisper-small-uz-onnx-int8",
    encoder_file_name="encoder_model_quantized.onnx",
    decoder_file_name="decoder_model_quantized.onnx",
    decoder_with_past_file_name="decoder_with_past_model_quantized.onnx",
)

# Transcribe audio (numpy float32 array at 16 kHz)
inputs = processor(audio_array, sampling_rate=16000, return_tensors="pt")
with torch.no_grad():
    predicted_ids = model.generate(
        inputs.input_features,
        language="uz",
        task="transcribe",
    )
transcription = processor.batch_decode(predicted_ids, skip_special_tokens=True)[0]
print(transcription)

Training & Evaluation

The parent model was fine-tuned on the DavronSherbaev/uzbekvoice-filtered dataset. WER was measured on 200 samples from the validation split using jiwer.