Downloads · 30 days
149
26% of all-time downloads
indic-conformer-600m-int8-onnx
yashwork-byte/indic-conformer-600m-int8-onnx
indic-conformer-600m-int8-onnx is a machine learning model from yashwork-byte. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Int8 dynamically-quantized copy of ai4bharat/indic-conformer-600m-multilingual (MIT): the ONNX encoder is quantized from 2.4 GB fp32 (external data) to a self-contained 0.62 GB int8 file; everything else (CTC decoder,…
All-time downloads
567
Public
Repo size
772 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.onnx735 MB · 95%
At a glance
- License
- mit
- Access
- Public
- Created
- Jul 18, 2026
- Updated
- Jul 18, 2026
- SHA
- 9c590ef6
Base models
Model card
From the Hugging Face model README
indic-conformer-600m-int8-onnx
Int8 dynamically-quantized copy of ai4bharat/indic-conformer-600m-multilingual (MIT): the ONNX encoder is quantized from 2.4 GB fp32 (external data) to a self-contained 0.62 GB int8 file; everything else (CTC decoder, per-language heads, preprocessor, remote code) is unchanged.
Why: the fp32 encoder needs ~2.6 GB resident — too much next to an LLM on an 8 GB device. Int8 cuts peak RSS to ~1.1 GB and speeds up loading ~3×, with a measured WER cost of ≈ +0.5 points on one of six spot-checked conversational clips (the rest bit-identical).
from transformers import AutoModel
model = AutoModel.from_pretrained("yashwork-byte/indic-conformer-600m-int8-onnx",
trust_remote_code=True)
text = model(wav_16k_mono_tensor, "hi", "ctc")
Built for the voice-note-digester
project (quantize_stt.py — onnxruntime dynamic quantization, QInt8
weights). All credit for the model to AI4Bharat;
this repo only repackages it for memory-constrained on-device use.
- License
- mit
- Languages
- hi, bn, ta, as, gu, kn
- Created
- Jul 18, 2026
- Updated
- Jul 18, 2026