Downloads · 30 days
23
22% of all-time downloads
abhinandansamal/nllb-200-distilled-600M-full-finetuned-odia-german-bidirectional
nllb-200-distilled-600M-full-finetuned-odia-german-bidirectional is a translation model from abhinandansamal. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as apache-2.0.
This is a fine-tuned version of facebook/nllb-200-distilled-600M specialized for bidirectional translation between Odia (oryOrya) and German (deuLatn).
Downloads · 30 days
23
22% of all-time downloads
All-time downloads
106
Public
Parameters
615M
2.5 GB on disk
Likes
1
Trending 1
Click a slice to open those files.
.safetensors2.5 GB · 99%
From the Hugging Face model README
This is a fine-tuned version of facebook/nllb-200-distilled-600M specialized for bidirectional translation between Odia (ory_Orya) and German (deu_Latn).
This model was developed as part of a thesis project focused on effective fine-tuning strategies for low-resource language pairs within the journalistic domain. It was fine-tuned on a carefully constructed hybrid dataset, combining a larger set of high-quality, human-validated translations with a smaller set of machine-translated sentences to expand lexical, contextual and grammatical coverage.
Live Demo:
facebook/nllb-200-distilled-600MThe model was fine-tuned on a meticulously prepared parallel corpus. Initially, 3,676 unique parallel line pairs were collected. Each "line" in the corpus was designed to provide contextual information for the model, typically containing 2-3 sentences, although some lines consist of a single sentence.
The data originates from two specific Odia newspapers and encompasses a diverse range of news domains, including National, International, Lifestyle, Sports, Trade, Environmental, Science and Technology, Leisure, Commerce, Metro, State, and Editorial.
The curation process involved distinct quality control steps for each language:
Following this rigorous curation, the corpus was transformed into a final bidirectional training dataset, resulting in 7,352 distinct training instances. This was achieved by creating two training examples from each parallel pair, utilizing task-specific prefixes (translate Odia to German: and translate German to Odia:). The overall size of this dataset was carefully managed and selected as a practical upper limit dictated by the memory and computational constraints of the available single-GPU training environment (NVIDIA A100 on Google Colab Pro).
Here, you can check the dataset.
The model was fine-tuned using PyTorch and the Hugging Face Seq2SeqTrainer.
Key Hyperparameters:
per_device_train_batch_size=4 with gradient_accumulation_steps=4)fp16=True)gradient_checkpointing=TrueThe fine-tuned model's performance was rigorously evaluated against the original facebook/nllb-200-distilled-600M baseline on a held-out test set composed partially (77%) of human-validated sentence pairs. I report scores across three standard machine translation metrics: BLEU (higher is better), chrF (higher is better), and TER (Translation Edit Rate, where lower is better).
| Metric | Odia → German (Baseline) | Odia → German (Fine-Tuned) | German → Odia (Baseline) | German → Odia (Fine-Tuned) |
|---|---|---|---|---|
| BLEU | 22.0355 | 27.1802 | 9.3467 | 14.8624 |
| chrF++ | 43.3357 | 54.3083 | 38.3720 | 43.4127 |
| TER | 82.7669 | 64.5270 | 97.6340 | 74.4360 |
| COMET | -0.0285 | 0.5479 | 0.1876 | 0.8167 |
The evaluation demonstrates substantial and consistent improvements across both translation directions following the full fine-tuning process.
Odia → German (Generating the High-Resource Language)The fine-tuning process unlocked massive gains in generating German, transforming the model from a weak baseline into a much more competent translation system.
German → Odia (Generating the Low-Resource Language)Generating Odia remains a challenging task due to its morphological richness, but the fine-tuned model shows clear progress over the zero-shot baseline.
The Full Fine-Tuning approach has successfully adapted the NLLB model for this specific Odia-German bitext. The transition from negative/low COMET scores to positive, high-confidence scores confirms that the model is now effectively aligning the semantics of both languages, rather than just relying on random token matches.
The easiest way to use this model is with the translation pipeline from the transformers library. The model was trained to be bidirectional, and you can control the translation direction by specifying the src_lang and tgt_lang during the call.
from transformers import pipeline, AutoTokenizer, AutoModelForSeq2SeqLM
import torch
# Load the translation pipeline with your fine-tuned model
model_id = "abhinandansamal/nllb-200-distilled-600M-full-finetuned-odia-german-bidirectional"
translator = pipeline(
"translation",
model=model_id,
dtype=torch.float16 if torch.cuda.is_available() else torch.float32,
device_map="auto"
)
# --- Task Prefixes (As used in your training phase) ---
PREFIX_ORI_TO_DEU = "translate Odia to German: "
PREFIX_DEU_TO_ORI = "translate German to Odia: "
# --- Example 1: Translate Odia to German ---
odia_text = "ଆଜି ପାଗ ବହୁତ ଭଲ ଅଛି।"
# We prepend the prefix to match training conditions
input_text_1 = PREFIX_ORI_TO_DEU + odia_text
german_translation = translator(
input_text_1,
src_lang="ory_Orya",
tgt_lang="deu_Latn",
max_length=512
)
print(f"--- Example 1 ---")
print(f"Odia Input: {odia_text}")
print(f"German Output: {german_translation[0]['translation_text']}")
# --- Example 2: Translate German to Odia (Simple) ---
german_text_2 = "Wie ist deine Gesundheit?"
input_text_2 = PREFIX_DEU_TO_ORI + german_text_2
odia_translation_2 = translator(
input_text_2,
src_lang="deu_Latn",
tgt_lang="ory_Orya",
max_length=512
)
print(f"\n--- Example 2 ---")
print(f"German Input: {german_text_2}")
print(f"Odia Output: {odia_translation_2[0]['translation_text']}")
Note: While the model was trained with task prefixes (translate Odia to German:), using the translation pipeline with src_lang and tgt_lang arguments is the cleaner, recommended method for inference, as it abstracts this detail away.
This model is primarily intended for translating journalistic text between Odia and German. Given its training on articles from various news domains (e.g., National, International, Lifestyle, Sports, Science and Technology), it is suitable for academic research, cross-lingual information retrieval from news sources, and as a supportive tool for language learners focusing on news-related content in this specific language pair.
Despite the constraints in computational resources (single-GPU training on NVIDIA A100 via Google Colab Pro) and the relatively small, specialized dataset size (7,352 bidirectional lines), this fine-tuning process has achieved significant positive outcomes:
To further enhance the model's performance, generalizability, and address existing limitations, the following factors are key considerations for future development:
If you use this model or the associated methodology in your research, please cite the following thesis:
@mastersthesis{SamalThesis2025,
author = Abhinandan Samal,
title = Enhancing Contextual Understanding in Low-Resource Languages Using Multilingual Transformers,
school = IU International University of Applied Sciences,
year = 2025
}