origin-task3-indictrans2-lora

Origin SciHigh 2026 Task 3 IndicTrans2 LoRA

This repository contains a LoRA adapter for English-to-Bengali scientific-paper title translation. It is the Run 2 system submitted by team Origin to SciHigh 2026 Task 3.

The adapter must be loaded on top of ai4bharat/indictrans2-en-indic-1B at commit 10e65a9951a1e922cd109a95e8aba9357b62144b; it is not a standalone full model.

Model details

Training data and procedure

The adapter was trained only on the 60 official training triplets from the SciHigh 2026 Task 3 SpringerSSAT-Tiny-Multilingual split. Each input was the English title and each target was its expert Bengali translation. No synthetic examples or test labels were used.

The 20 official validation examples were held out from gradient optimization and used once per epoch for checkpoint selection.

Validation results

Scores below were calculated on the 20 held-out validation titles. ROUGE-L uses whitespace-delimited Bengali tokens

Usage

pip install "transformers==4.53.2" "peft>=0.16,<0.18" \
  "protobuf>=5,<7" "sentencepiece>=0.2,<0.3" torch
pip install "IndicTransToolkit @ git+https://github.com/VarunGumma/IndicTransToolkit.git@3efb8418d0721b4ce267c2b3586899d313191357"

import torch
from IndicTransToolkit import IndicProcessor
from peft import PeftModel
from transformers import AutoModelForSeq2SeqLM, AutoTokenizer

adapter_id = "uthayamurthy/origin-task3-indictrans2-lora"
base_id = "ai4bharat/indictrans2-en-indic-1B"
base_revision = "10e65a9951a1e922cd109a95e8aba9357b62144b"
device = "cuda" if torch.cuda.is_available() else "cpu"

tokenizer = AutoTokenizer.from_pretrained(
    base_id, revision=base_revision, trust_remote_code=True
)
base_model = AutoModelForSeq2SeqLM.from_pretrained(
    base_id,
    revision=base_revision,
    trust_remote_code=True,
    torch_dtype=torch.bfloat16 if device == "cuda" else torch.float32,
)
model = PeftModel.from_pretrained(base_model, adapter_id).to(device).eval()
processor = IndicProcessor(inference=True)

title = "A framework to measure microaggressions in the mathematics classroom"
processed = processor.preprocess_batch(
    [title], src_lang="eng_Latn", tgt_lang="ben_Beng"
)
inputs = tokenizer(processed, return_tensors="pt").to(device)
with torch.inference_mode():
    tokens = model.generate(**inputs, num_beams=5, max_new_tokens=96)
decoded = tokenizer.batch_decode(tokens, skip_special_tokens=True)
print(processor.postprocess_batch(decoded, lang="ben_Beng")[0])