WMT25-EuroLLM-9B-CPO

QLoRA Model: WMT25-EuroLLM-9B-CPO

This repository contains QLoRA weights for the utter-project/EuroLLM-9B-Instruct model.

This adapter was trained as part of the research for Laniqo's submission to the WMT25 General MT Shared Task.

Paper: TBA

Authors: Kamil Guttmann, Zofia Rostek, Adrian Charkiewicz, Antoni Solarski, Mikołaj Pokrywka, Artur Nowakowski

Model Description

This QLoRA improves multilingual translation quality by aligning its outputs more closely with neural MT quality metrics, which are known to correlate highly with human preferences.

It was trained using the Contrastive Preference Optimization method on a synthetic preference dataset. This dataset was generated by applying Minimum Bayes Risk decoding to 10,000 examples per language pair from the NewsPALM dataset, covering translations from English to Korean, Japanese, Ukrainian, Czech, Chinese, Russian, and Estonian.

Training Details

• Base Model: utter-project/EuroLLM-9B-Instruct
• Training Method: Contrastive Preference Optimization with QLoRA.
• Dataset: A synthetic preference dataset created from the NewsPALM corpus via MBR decoding.

Key Hyperparameters