GaloNMT-7K

GaloNMT — English → Galo Neural Machine Translation

GaloNMT is a vanilla Transformer-based neural machine translation model that translates English text into Galo, a Tibeto-Burman language spoken by the Galo community in Arunachal Pradesh, India. Galo is classified as a low-resource language with very limited digital representation, making this one of the first dedicated NMT systems for the language.

Model Details

Architecture Hyperparameters

Training Configuration

Training Data

The model was trained on the Galo Bible Parallel Corpus, a sentence-aligned English–Galo parallel corpus derived from Bible translations.

The dataset was split using an 80 : 10 : 10 ratio (train / validation / test) with a fixed random seed of 42 for reproducibility.

Evaluation Results

Evaluation was performed on 100 randomly sampled sentences from the held-out test set using SacreBLEU.

Sample Translations

Note: The model shows signs of repetition in some outputs, a common phenomenon in low-resource NMT settings. See Limitations for details.

How to Use

Requirements

pip install torch tokenizers

Inference

import torch
import json
from tokenizers import Tokenizer

with open("GaloNMT/config.json", "r") as f:
    config = json.load(f)

en_tokenizer = Tokenizer.from_file("GaloNMT/en_tokenizer.json")
galo_tokenizer = Tokenizer.from_file("GaloNMT/galo_tokenizer.json")

PAD_IDX = en_tokenizer.token_to_id("[PAD]")
SOS_IDX = en_tokenizer.token_to_id("[SOS]")
EOS_IDX = en_tokenizer.token_to_id("[EOS]")

def translate(sentence, model, max_len=64):
    model.eval()
    tokens = [SOS_IDX] + en_tokenizer.encode(sentence).ids + [EOS_IDX]
    src = torch.tensor(tokens).unsqueeze(0).to(device)
    src_mask = (src != PAD_IDX).unsqueeze(1).unsqueeze(2)

    trg_indexes = [SOS_IDX]
    for _ in range(max_len):
        trg_tensor = torch.tensor(trg_indexes).unsqueeze(0).to(device)
        trg_mask = torch.tril(
            torch.ones((1, 1, len(trg_indexes), len(trg_indexes)), device=device)
        ).bool()
        with torch.no_grad():
            output = model(src, trg_tensor, src_mask, trg_mask)
        pred_token = output.argmax(2)[:, -1].item()
        trg_indexes.append(pred_token)
        if pred_token == EOS_IDX:
            break

    return galo_tokenizer.decode(trg_indexes)

Intended Use

• Primary use: Research and experimentation in low-resource neural machine translation for the Galo language.
• Secondary use: Supporting language documentation and digital preservation efforts for the Galo community.
• Not intended for: Production-grade translation systems, legal or medical translation, or any high-stakes application where translation accuracy is critical.

Limitations

• Small training corpus: The model is trained on only ~7,700 sentence pairs from a single domain (Bible text), which limits its vocabulary coverage and generalization to other domains.
• Repetitive outputs: Due to the low-resource setting and small model size, the decoder occasionally produces repetitive n-grams — a well-known issue in autoregressive NMT.
• Single domain: Performance on out-of-domain text (news, conversational, technical) is expected to be significantly lower than the reported metrics.
• No beam search: The current inference uses greedy decoding. Beam search or sampling strategies may improve output quality.
• No back-translation or data augmentation: The model was trained on parallel data only, without synthetic data augmentation techniques.

Ethical Considerations

• The training data is derived from publicly available Bible translations. Care should be taken when using the model in culturally sensitive contexts.
• Galo is a language spoken by an indigenous community. Any deployment or public-facing use of this model should involve community consultation and respect for indigenous language rights.
• This model should not be used to generate content that misrepresents the Galo language or culture.

Training Loss Curve

The model trained for 30 epochs with the following loss progression:

Model Files

GaloNMT/
├── config.json            # Model architecture configuration
├── model.pt               # Trained model weights (~34.7 MB)
├── en_tokenizer.json      # English BPE tokenizer
├── galo_tokenizer.json    # Galo BPE tokenizer
└── README.md              # This model card

Citation

If you use this model in your research, please cite:

@misc{galonmt2026,
  title        = {GaloNMT: Neural Machine Translation for Galo to English},
  author       = {Jurist Dupit},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/GaloNMT}},
  note         = {Vanilla Transformer trained on the Galo Bible Parallel Corpus},
  institute = {Rajiv Gandhi University Rono Hills Doimukh}
}

Acknowledgements

This work contributes to the digital preservation and computational linguistic support for the **Galo ** language. We thank the Galo-speaking community for the linguistic resources that made this project possible.