Downloads · 30 days
0
mariklolik228/ExOPD-Arabic-Qwen3-8B
ExOPD-Arabic-Qwen3-8B is a machine learning model from mariklolik228. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Paper: ExOPD-Arabic: Extrapolated On-Policy Distillation from a 235B Teacher to a Specialized 8B Arabic Student
Downloads · 30 days
0
Access
Public
Updated Mar 2, 2026
Repo size
1.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors1.4 GB · 78%
From the Hugging Face model README
Paper: ExOPD-Arabic: Extrapolated On-Policy Distillation from a 235B Teacher to a Specialized 8B Arabic Student
Authors: Mark Kashirskiy, Artiom Lipinski, Ilya Makarov
ExOPD-Arabic is a LoRA adapter for Qwen3-8B-Base, trained via Extrapolated On-Policy Distillation (ExOPD) with λ=1.25 reward extrapolation from Qwen3-235B-A22B teacher. Achieves strong Arabic performance through 3-round iterative on-policy preference optimization.
See paper for full benchmark results.