Downloads · 30 days
0
Rome-1/qwen2.5-3b-yoruba-autoscientist-part2
qwen2.5-3b-yoruba-autoscientist-part2 is a machine learning model from Rome-1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
QLoRA SFT of Qwen/Qwen2.5-3B on an Adaption-localized Yoruba instruction set (languageexpansion, localize → Yoruba/NG). Trained on a single free Kaggle T4.
Downloads · 30 days
0
Access
Public
Updated Jul 19, 2026
Repo size
131 MB
Likes
0
Public
Click a slice to open those files.
.safetensors120 MB · 91%
From the Hugging Face model README
QLoRA SFT of Qwen/Qwen2.5-3B on an Adaption-localized Yoruba instruction set (language_expansion,
localize → Yoruba/NG). Trained on a single free Kaggle T4.
| Corpus | Base → Tuned |
|---|---|
| Natural Yoruba (human-written FLORES/Belebele passages, n=200) | 43.619 → 13.943 (68.03% lower) |
| English control (n=100) | 13.518 → 14.286 (-5.68%) |
| In-distribution held-out (n=150) | 20.219 → 2.983 (85.25% lower) |
Natural Yoruba is the headline. It is human-written text that this model never trained on and that Adaption never generated, so it measures genuine Yoruba language modeling rather than having learned the data generator's format.
English perplexity rises 5.7% — a modest but real regression, the expected cost of specializing a 3B model this hard on Yoruba. The model stays usable in English; if English retention matters for your use, a lighter-trained checkpoint trades ~6% of this English loss for a few points of Yoruba.
The in-distribution number is reported for completeness and is deliberately not the headline: it is scored on held-out rows from the same generator as the training data, which inflates it and saturates it. Treat it as a sanity check, not a result.
Held-out membership is a stable hash of the prompt, so it is fixed and disjoint from training at any corpus size and comparable across runs.