Downloads · 30 days
40
8% of all-time downloads
ascolda/nllb-200-distilled-600M_ru_en_finetuned_crystallography
nllb-200-distilled-600M_ru_en_finetuned_crystallography is a translation model from ascolda. Use it when you need text moved from one language to another. It is set up for transformers.
This model is a fine-tuned version of facebook/nllb-200-distilled-600M trained on the ascolda/ruenCrystallographyandSpectroscopy dataset. It achieves the following results on the evaluation set:
Downloads · 30 days
40
8% of all-time downloads
All-time downloads
493
Public
Repo size
4.9 GB
Likes
3
Public
Click a slice to open those files.
.bin2.5 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of facebook/nllb-200-distilled-600M trained on the ascolda/ru_en_Crystallography_and_Spectroscopy dataset. It achieves the following results on the evaluation set:
The finetuned model yieled better performance on the machine translation task of domain-specific scientific articles related to the Crystallography and Spectroscopy domain.
Below is the comparison of the translation quality metrics for the original NLLB model and my finetuned version. Evaluation is focused on: (1) general translation quality, (2) quality of translation of specific terminology, and (3) uniformity of translation of domain-specific terms in different contexts.
(1) The general translation quality was evaluated using the Bleu metric.
(2) Term Success Rate. In the terminology success rate we compared the machine-translated terms with their dictionary equivalents by checking for the presence of the reference terminology translation in the output by the regular expression match.
(3) Term Consistency. This metric looks at whether technical terms are translated uniformly across the entire text corpus in different contexts. We aim for high consistency, measured by the low occurrence of multiple translations for the same term within the evaluation dataset.
| Model | BLEU | Term Success Rate | Term Consistency |
|---|---|---|---|
| nllb-200-distilled-600M | 38.19 | 0.246 | 0.199 |
| nllb-200-distilled-600M_ru_en_finetuned_crystallography | 56.59 | 0.573 | 0.740 |