Downloads · 30 days
403
30% of all-time downloads
hari31416/indictrans2-indic-en-dist-200M-ONNX-int8
indictrans2-indic-en-dist-200M-ONNX-int8 is a translation model from hari31416. Use it when you need text moved from one language to another. It is set up for onnx. The card lists the license as mit.
[!TIP] This model is part of a suite of optimized/quantized ONNX versions of the base model. Other variants in this direction: - FP32 (Full Precision / Base): hari31416/indictrans2-indic-en-dist-200M-ONNX - FP16 (Half…
Downloads · 30 days
403
30% of all-time downloads
All-time downloads
1.4K
Public
Repo size
597 MB
Likes
0
Public
Click a slice to open those files.
.data230 MB · 85%
From the Hugging Face model README
[!TIP] This model is part of a suite of optimized/quantized ONNX versions of the base model. Other variants in this direction:
- FP32 (Full Precision / Base):
hari31416/indictrans2-indic-en-dist-200M-ONNX- FP16 (Half Precision):
hari31416/indictrans2-indic-en-dist-200M-ONNX-fp16- INT8 (Dynamic Quantization):
hari31416/indictrans2-indic-en-dist-200M-ONNX-int8(Current)- Q4F16 (4-bit Block Quantization):
hari31416/indictrans2-indic-en-dist-200M-ONNX-q4f16
ONNX-exported and quantized version of ai4bharat/indictrans2-indic-en-dist-200M
for in-browser and local edge inference.
Built for use with Transformers.js and onnxruntime-web in the browser, with fast BPE tokenizer.json files that don't require the SentencePiece WASM runtime.
These charts show overall tradeoffs, language-level parity, and category breakdown.

Compared against the FP32 ONNX oracle on the golden evaluation fixtures.
| Format | Model Size | Exact Match (Token) | Exact Match (Text) | SacreBLEU (Raw) | Latency (Mean) | Speedup vs. FP32 |
|---|---|---|---|---|---|---|
| FP32 | 1.19 GB | 100.00% | 100.00% | 100.00 | 12.2 ms | 1.000x |
| FP16 | 627.2 MB | 99.91% | 99.91% | 99.96 | 14.3 ms | 0.849x |
| INT8 | 319.7 MB | 85.64% | 85.64% | 94.34 | 10.1 ms | 1.171x |
| Q4F16 | 358.6 MB | 73.36% | 73.36% | 88.31 | 15.8 ms | 0.742x |
Exact match rates and translation quality (SacreBLEU / chrF) per language pair under this precision:
| Language Code | Total Fixtures | Token Match Rate | Text Match Rate | SacreBLEU | SacreBLEU (chrF) |
|---|---|---|---|---|---|
| eng_Latn | 1100 | 85.6% | 85.6% | 94.34 | 97.30 |
Exact match rates and translation quality grouped by category types:
| Category | Total Fixtures | Token Match Rate | Text Match Rate | SacreBLEU | SacreBLEU (chrF) |
|---|---|---|---|---|---|
| Generic | 286 | 84.6% | 84.6% | 93.64 | 97.02 |
| Lexicon | 264 | 83.7% | 83.7% | 94.00 | 96.85 |
| Numerals | 264 | 87.5% | 87.5% | 95.02 | 97.83 |
| Politics | 286 | 86.7% | 86.7% | 94.70 | 97.53 |
Here is a sample of up to 5 translation mismatches compared to the FP32 oracle. Many mismatches represent minor synonym differences or spacing variations.
কৃত্ৰিম বুদ্ধিমত্তাই শিক্ষাৰ ক্ষেত্ৰত পৰিৱৰ্তন কঢ়িয়াই আহিছে।Artificial intelligence is changing education.Artificial intelligence is bringing changes in the field of education.ভাল বৰষুণৰ ফলত শস্যৰ উৎপাদন উন্নত হৈছে।Good rainfall has improved crop yields.The good rainfall has improved crop yields.এই চুক্তি এবছৰৰ বাবে বৈধ।The agreement is valid for one year.This agreement is valid for one year.প্ৰতিদিনে যথেষ্ট পৰিমাণে পানী খোৱাটো অতি গুৰুত্বপূৰ্ণ।It is important to drink plenty of water every day.It is very important to drink plenty of water every day.তেওঁ বিশ্ববিদ্যালয়ৰ পৰা সন্মানসহ স্নাতক ডিগ্ৰী লাভ কৰিছিল।He received a bachelor's degree with honors from the university.He graduated with honors from the university.encoder_model.onnx (and optional .onnx.data weights sidecar)decoder_model.onnx and decoder_with_past_model.onnx (share decoder_shared.onnx.data when present)translate.py — self-contained Python inference helper (see Usage below)tokenizer_src.json, tokenizer_tgt.json, tokenizer_meta.json)config.json, generation_config.json)# translate.py is included in this repo alongside the ONNX bundle.
# You can also find it (and read the full source) at:
# https://github.com/Hari31416/indictrans2-onnx-export/blob/main/src/translate.py
from translate import IndicTransONNX
# Pass a HF repo ID for automatic download, or a local bundle directory path
model = IndicTransONNX("hari31416/indictrans2-indic-en-dist-200M-ONNX-int8")
print(model.translate("चुनाव कौन जीतेगा?", src_lang="hin_Deva", tgt_lang="eng_Latn"))
Required packages:
pip install onnxruntime tokenizers huggingface-hub
MIT (preserved from upstream AI4Bharat).