Downloads · 30 days
27
11% of all-time downloads
thenlpresearcher/shalaka_indictrans2-en-indic-dist-200M_finetuned_eng_Latn_to_mar_Deva
shalaka_indictrans2-en-indic-dist-200M_finetuned_eng_Latn_to_mar_Deva is a translation model from thenlpresearcher. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as mit.
This model is a fine-tuned version of ai4bharat/indictrans2-en-indic-dist-200M for English-to-Marathi machine translation. It is specifically designed to be robust to punctuation errors or omissions in the source Engl…
Downloads · 30 days
27
11% of all-time downloads
All-time downloads
245
Public
Parameters
212M
851 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors847 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of ai4bharat/indictrans2-en-indic-dist-200M for English-to-Marathi machine translation. It is specifically designed to be robust to punctuation errors or omissions in the source English text.
The model was developed as part of the research presented in the paper Assessing and Improving Punctuation Robustness in English-Marathi Machine Translation.
This model follows the Direct Fine-tuning methodology (referred to as Approach 2 in the paper). It was fine-tuned on an augmented version of the IITB-ENG-MAR corpus, where English source sentences were provided in both punctuated and unpunctuated forms (2x data size). This approach allows the model to implicitly learn the context required to resolve semantic ambiguities caused by missing punctuation—such as distinguishing vocative uses—directly during the translation process.
This model is intended for translating English text to Marathi, particularly in cases where the input may lack proper punctuation or contains punctuation-induced ambiguities.
The model was evaluated against the Virām benchmark, which focuses on 54 manually curated instances where punctuation significantly changes the structural or semantic meaning of the sentence.
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Bleu | Chrfpp | Comet | Bleurt | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 0.4656 | 0.2530 | 6000 | 0.4509 | 8.9549 | 31.0209 | 0.5263 | None | 20.8016 |
| 0.4422 | 0.5059 | 12000 | 0.4280 | 9.2261 | 31.368 | 0.5289 | None | 20.8337 |
| 0.4497 | 0.7589 | 18000 | 0.4152 | 9.5103 | 31.6753 | 0.5318 | None | 20.8757 |
| 0.4041 | 1.0119 | 24000 | 0.4080 | 9.5567 | 31.8224 | 0.5328 | None | 20.8751 |
| 0.3974 | 1.2649 | 30000 | 0.4023 | 9.6304 | 31.9291 | 0.5333 | None | 20.8776 |
| 0.3874 | 1.5178 | 36000 | 0.3973 | 9.6925 | 31.9776 | 0.5336 | None | 20.8777 |
| 0.3899 | 1.7708 | 42000 | 0.3937 | 9.7282 | 32.031 | 0.5337 | None | 20.8775 |
| 0.3735 | 2.0238 | 48000 | 0.3917 | 9.7847 | 32.0965 | 0.5341 | None | 20.8778 |
| 0.3825 | 2.2768 | 54000 | 0.3887 | 9.7889 | 32.1173 | 0.5342 | None | 20.8768 |
| 0.3736 | 2.5297 | 60000 | 0.3878 | 9.8511 | 32.1897 | 0.5346 | None | 20.8772 |
| 0.3684 | 2.7827 | 66000 | 0.3869 | 9.858 | 32.2074 | 0.5346 | None | 20.877 |
@article{shejole2025assessing,
title={Assessing and Improving Punctuation Robustness in English-Marathi Machine Translation},
author={Shejole, Kaustubh and Sakhare, Shalaka and Deoghare, Sourabh},
journal={arXiv preprint},
year={2025}
}