Downloads · 30 days
16
20% of all-time downloads
qwen-grpo-r4-s125
cmpatino/qwen-grpo-r4-s125
qwen-grpo-r4-s125 is a text generation model from cmpatino. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
inspectevals/gsm8k, full 1319-sample test set, 10-shot, greedy: 0.7081 +/- 0.0125 (untrained Qwen/Qwen3-0.6B baseline: 0.4754 +/- 0.0138).
All-time downloads
79
Public
Parameters
596M
2.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Aug 3, 2026
- Updated
- Aug 3, 2026
- SHA
- 1cc92f4d
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Qwen3-0.6B + GRPO on GSM8K -- intermediate checkpoint (step 125 of run r4)
inspect_evals/gsm8k, full 1319-sample test set, 10-shot, greedy: 0.7081 +/- 0.0125
(untrained Qwen/Qwen3-0.6B baseline: 0.4754 +/- 0.0138).
A statistical tie with the campaign's best model, cmpatino/qwen-grpo-r5
(0.7089 +/- 0.0125) -- see that model card for the full recipe, reward function, and caveats.
Note this is the step-125 checkpoint, which scores higher than run r4's final step-129 weights (0.6907).
Runs in non-thinking mode: the chat template always emits an empty <think></think> block.
Use the tokenizer shipped in this repo.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Created
- Aug 3, 2026
- Updated
- Aug 3, 2026