Downloads · 30 days
20
49% of all-time downloads
joey00072/Qwen3.6-35B-A3B-countdown-GRPO-20260909
Qwen3.6-35B-A3B-countdown-GRPO-20260909 is a reinforcement learning model from joey00072. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This checkpoint specializes in countdown puzzles through 40 verifier-reward GRPO updates. The base model is Qwen/Qwen3.6-35B-A3B at revision 995ad96eacd98c81ed38be0c5b274b04031597b0. Miles source is radixark/miles PR…
Downloads · 30 days
20
49% of all-time downloads
All-time downloads
41
Public
Parameters
35.5B
71 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors71 GB · 100%
How the weights are stored.
BF1635.5B · 100%
From the Hugging Face model README
This checkpoint specializes in countdown puzzles through 40 verifier-reward GRPO updates. The base model is Qwen/Qwen3.6-35B-A3B at revision 995ad96eacd98c81ed38be0c5b274b04031597b0. Miles source is radixark/miles PR 3116 at revision 8f8e4dff55d80bd9d36c3490c333a119f38480ed. Reasoning Gym revision 49b07130b3fcd12f2d064bba7c43869543a0e7e7 generated 10,000 training puzzles per domain. Each update used 32 prompts with 8 responses each, a global batch of 256, learning rate 1e-6, and a 256-token response cap with thinking disabled. Each teacher trained on one node with eight NVIDIA B200 GPUs. SGLang used the Triton MoE backend because automatic backend selection failed during weight transfer. The export contains the trained language-model weights. No claim is made about multimodal capabilities or equivalence to the PR's reported results. Development evaluations used 512 puzzles per domain. The held-out test set has not been evaluated. The model requires independent validation before downstream use.