Luth-2-0.8B-GGUF

Luth-2-0.8B

Luth-2-0.8B is a 750M-parameter (text only) non-reasoning model, setting a new state of the art in French for its size across math, code, instruction following, general knowledge and tool calling. It is trained on a 3B-token French SFT mixture followed by multi-domain on-policy distillation (MOPD). The model outperforms every other model in its size class on our selected French benchmarks and stays competitive with models 2 to 3 times larger. It is small enough for efficient local and on-device deployment.

• 📄 Blog: Luth-2: Pushing the French Capabilities of SLMs with MOPD
• 🤗 Models: Luth-2-0.8B · Luth-2-2B
• 📊 Datasets: SFT · RL
• 💻 Code: GitHub
• 🏆 Leaderboard: French LLM Leaderboard

Example usage with llama.cpp:

llama-cli -hf kurakurai/Luth-2-0.8B-GGUF:Q4_K_M -c 4096 --color -i \
    --temp 0.8 --top-k 20 --top-p 0.95

Contact

Questions or feedback? Reach us on LinkedIn: Maxence Lasbordes and Guillaume Pradel.

Citation

@misc{luth2,
  title  = {Luth-2: Pushing the French Capabilities of SLMs with MOPD},
  author = {Maxence Lasbordes and Guillaume Pradel},
  year   = {2026},
  url    = {https://huggingface.co/blog/MaxLSB/luth-2}
}