Snowball-67B-A2B-Math-RL-E18-Step8

Snowball-67B-A2B-Math-RL-E18-Step8

This is the exact checkpoint used for a reported row in the Snowball 67B-A2B math-RL experiment.

Router state: Frozen router bias; zero drift against 5.7T start. Closely named older laion/rl-snowball-* repositories may contain raw mutable-router exports that collapse under inference. Do not substitute them for this artifact. Models from this campaign are research checkpoints, not production releases; their utility is limited unless router-bias repair or frozen-router integrity is preserved.

• Arm: E18
• Step: 8
• Held-out AIME24 / MATH-500 / OlympiadBench: 37.33 / 83.00 / 13.33
• Selection: Campaign-best absolute AIME24 and MATH-500
• Source artifact: s3://marin-us-east-02a/marin/users/benjaminfeuer/skyrl/rl-snowball-e18-rno2a-rlvrmath-frozen-sr-57t-agentic-20260826-102929/exports/global_step_8/policy/
• Experiment issue: https://github.com/marin-community/marin/issues/7786
• Evidence archive: https://huggingface.co/datasets/penfever/snowball-67b-a2b-math-rl-artifacts

The scores and evaluation caveats are recorded in MATH_EVALS.md in the evidence archive. Preserve config.json, the tokenizer files, and all shards named by model.safetensors.index.json together.