Snowball-67B-A2B-Math-RL-E2-Unreg-Step20

Snowball-67B-A2B-Math-RL-E2-Unreg-Step20

This is the exact checkpoint used for a reported row in the Snowball 67B-A2B math-RL experiment.

Router state: SFT router-bias repaired. Closely named older laion/rl-snowball-* repositories may contain raw mutable-router exports that collapse under inference. Do not substitute them for this artifact. Models from this campaign are research checkpoints, not production releases; their utility is limited unless router-bias repair or frozen-router integrity is preserved.

• Arm: E2 unregularized
• Step: 20
• Held-out AIME24 / MATH-500 / OlympiadBench: 18.00 / 71.40 / 14.67
• Selection: Final and strongest aggregate E2-unreg checkpoint
• Source artifact: s3://marin-us-east-02a/marin/exports/snowball-bias-repaired/rl-snowball-e2-rno2a-unreg-grug-67b-a2b-20260731-104020-c86049/global_step_20/policy/
• Experiment issue: https://github.com/marin-community/marin/issues/7786
• Evidence archive: https://huggingface.co/datasets/penfever/snowball-67b-a2b-math-rl-artifacts

The scores and evaluation caveats are recorded in MATH_EVALS.md in the evidence archive. Preserve config.json, the tokenizer files, and all shards named by model.safetensors.index.json together.

We release our tools to the public with the intent that they are used safely, ethically, and responsibly. They are meant to contribute to the public's understanding of science, and aid in its advancement. By using this Marin model, you agree to comply with all applicable law.