Downloads · 30 days
23
100% of all-time downloads
Snowball-67B-A2B-Math-RL-E14-Step16
open-athena/Snowball-67B-A2B-Math-RL-E14-Step16
Snowball-67B-A2B-Math-RL-E14-Step16 is a reinforcement learning model from open-athena. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This is the exact checkpoint used for a reported row in the Snowball 67B-A2B math-RL experiment.
All-time downloads
23
Public
Parameters
67.1B
268 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors268 GB · 100%
At a glance
- Task
- Reinforcement Learning
- License
- other
- Model type
- grug_moe
- Access
- Public
- Created
- Sep 20, 2026
- Updated
- Sep 20, 2026
- SHA
- d03f6fd4
Model card
From the Hugging Face model README
Snowball-67B-A2B-Math-RL-E14-Step16
This is the exact checkpoint used for a reported row in the Snowball 67B-A2B math-RL experiment.
Router state: Frozen router bias. Closely named older laion/rl-snowball-* repositories may contain raw mutable-router exports that collapse under inference. Do not substitute them for this artifact. Models from this campaign are research checkpoints, not production releases; their utility is limited unless router-bias repair or frozen-router integrity is preserved.
- Arm:
E14 - Step:
16 - Held-out AIME24 / MATH-500 / OlympiadBench:
20.67 / 73.80 / 15.67 - Selection: Final and strongest E14 checkpoint
- Source artifact:
s3://marin-us-east-02a/marin/users/benjaminfeuer/skyrl/rl-snowball-e14-rno2a-dapo17k-grpo-ctx10-20260822-152413-d22187/exports/global_step_16/policy/ - Experiment issue: https://github.com/marin-community/marin/issues/7786
- Evidence archive: https://huggingface.co/datasets/penfever/snowball-67b-a2b-math-rl-artifacts
The scores and evaluation caveats are recorded in MATH_EVALS.md in the evidence archive. Preserve config.json, the tokenizer files, and all shards named by model.safetensors.index.json together.
- Task
- Reinforcement Learning
- Type
- grug_moe
- License
- other
- Created
- Sep 20, 2026
- Updated
- Sep 20, 2026