Downloads · 30 days
0
thegovind/azure-advisor-qwen35-0.8b-grpo
azure-advisor-qwen35-0.8b-grpo is a text generation model from thegovind. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
SFT + rejection-sampling GRPO on Qwen/Qwen3.5-0.8B.
Downloads · 30 days
0
Access
Public
Updated Apr 17, 2026
Repo size
45.6 MB
Likes
0
Public
Click a slice to open those files.
.safetensors25.6 MB · 56%
From the Hugging Face model README
SFT + rejection-sampling GRPO on Qwen/Qwen3.5-0.8B.
| iter | train loss | avg gen reward | max-of-N |
|---|---|---|---|
| 1 | 0.0563 | 6.040 | 6.040 |
| 2 | 0.0373 | 5.705 | 5.794 |
| 3 | 0.0328 | 7.211 | 7.211 |
| Stage | Qwen2.5-0.5B | Qwen3.5-0.8B |
|---|---|---|
| Pre-SFT reward / 10 | 0.80 | TBD |
| Post-SFT reward / 10 | 3.43 | 4.69 |
| GRPO iter 3 gen reward | 4.44 | 4.69 |