Gemma3-En2Indic-NMT-270M

Gemma-3-270M English → Indic Translator

A fine-tuned version of Gemma-3-270m-it for multilingual machine translation from English to 14 Indic languages.

This model is designed for lightweight, fast, and high-quality translation from English into major Indic languages while maintaining the conversational capabilities inherited from Gemma-3.

Model Details

Supported Languages

Input language is always English.

Dataset

The model was fine-tuned using the AI4Bharat BPCC (bpcc-seed-v2) multilingual parallel corpus.

The dataset contains parallel English–Indic sentence pairs covering multiple domains and language families.

Prompt Format

The model expects prompts in the following format:

Translate to {Target Language}:

{English Sentence}

Example:

Translate to Telugu:

Artificial Intelligence is changing healthcare.

Usage

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM

MODEL_NAME = "ManiKumarAdapala/Gemma3-En2Indic-NMT-270M"

tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
tokenizer.padding_side = "left"

model = AutoModelForCausalLM.from_pretrained(
    MODEL_NAME,
    dtype=torch.bfloat16,
    attn_implementation="flash_attention_2",
    device_map={"": 0},
)

model.config.use_cache = True
model.eval()

EOT = tokenizer.convert_tokens_to_ids("<end_of_turn>")


@torch.inference_mode()
def translate(sentences, language):

    if isinstance(sentences, str):
        sentences = [sentences]

    prompts = [
        tokenizer.apply_chat_template(
            [
                {
                    "role": "user",
                    "content": f"Translate to {language}:\n\n{s}",
                }
            ],
            tokenize=False,
            add_generation_prompt=True,
        )
        for s in sentences
    ]

    inputs = tokenizer(
        prompts,
        return_tensors="pt",
        padding=True,
        add_special_tokens=False,
    ).to(model.device)

    outputs = model.generate(
        **inputs,
        max_new_tokens=256,
        do_sample=False,
        num_beams=5,
        eos_token_id=[
            tokenizer.eos_token_id,
            EOT,
        ],
        pad_token_id=tokenizer.pad_token_id,
    )

    generated = outputs[:, inputs["input_ids"].shape[1]:]

    return tokenizer.batch_decode(
        generated,
        skip_special_tokens=True,
    )


sentence = "Artificial Intelligence is transforming agriculture."

translation = translate(sentence, "Hindi")

print(translation[0])

Recommended Generation Settings

max_new_tokens = 256
num_beams = 5
do_sample = False
use_cache = True
padding_side = "left"
dtype = torch.bfloat16
attn_implementation = "flash_attention_2"

These settings are the same as those used in the provided inference notebook and are recommended for obtaining deterministic, high-quality translations.

Evaluation

The model was evaluated using sentence pairs from the BPCC dataset.

Metrics used:

• BLEU
• chrF2

Average benchmark results:

Known Limitations

Like most compact multilingual translation models, this model has a few limitations.

• Numerical values may occasionally change during translation.
• Rarely, Latin characters may appear within Indic script outputs.
• Translation quality varies across languages, with lower-resource languages generally being more challenging.
• Not intended for legal, medical, or other safety-critical translation tasks without human verification.

Citation

@misc{Gemma3-En2Indic-NMT-270M,
  title = {Gemma3-En2Indic-NMT-270M: English to Indic Neural Machine Translation},
  author = {Adapala, Mani Kumar},
  year = {2026},
  publisher = {Hugging Face},
  url = {https://huggingface.co/ManiKumarAdapala/Gemma3-En2Indic-NMT-270M}
}

Acknowledgements

This work builds upon:

• Google for the Gemma-3 model.
• AI4Bharat for the BPCC multilingual parallel corpus.
• Hugging Face for the Transformers ecosystem.
• The open-source community for tools and libraries that enabled this work.