Luth-Instruct-GGUF

Luth-Instruct-GGUF

Luth-1.7B-Instruct is a French fine-tuned variant of the Qwen3-1.7B model, enhanced using the Luth-SFT dataset to significantly improve its capabilities in French instruction following, mathematics, and general knowledge while maintaining and even boosting its English performance. It was trained by full fine-tuning with Axolotl and later merged with the base Qwen3-1.7B, thus preserving its English competencies alongside marked improvements in French benchmarks. The model demonstrates strong performance on selected French and English benchmarks, including ifeval, gpqa-diamond, mmlu, math-500, arc-chall, and hellaswag, showing notable gains over comparable models in both languages. It is designed for tasks requiring bilingual proficiency with pronounced strength in French and is supported by available evaluation, training, and data scripts on GitHub. The model is suitable for instruction-following applications in contexts demanding enhanced French language understanding without compromising English language capabilities. It is openly accessible under an appropriate license for research and usage.

Model Files

Luth-1.7B-Instruct

Luth-0.6B-Instruct

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):