Downloads · 30 days
5.1K
93% of all-time downloads
open-athena/Grug-67B-A2B-GLM53-RLVR-SFT-2026.09.23
Grug-67B-A2B-GLM53-RLVR-SFT-2026.09.23 is a text generation model from open-athena. Use it when you need the model to write or continue text. The card lists the license as openmdw-1.1.
This model continues open-athena/Grug-67B-A2B-Datakit-SFT-262K-2026.09.21 with supervised fine-tuning on 5,000 rendered GLM 5.3 RLVR conversations. The run used assistant-only loss, greedy packing into 32,768-token se…
Downloads · 30 days
5.1K
93% of all-time downloads
All-time downloads
5.5K
Public
Parameters
67.1B
268 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors268 GB · 100%
From the Hugging Face model README
This model continues open-athena/Grug-67B-A2B-Datakit-SFT-262K-2026.09.21 with supervised fine-tuning on 5,000 rendered GLM 5.3 RLVR conversations. The run used assistant-only loss, greedy packing into 32,768-token sequences, and 136 optimizer steps on 64 H100 GPUs.
The saved checkpoint is s3://marin-us-east-02a/marin/checkpoints/glm53-rlvr-snowball-sft-2026.09.23/hf/step-135. The model retains the base model's OpenMDW 1.1 license.
We release our tools to the public with the intent that they are used safely, ethically, and responsibly. They are meant to contribute to the public's understanding of science, and aid in its advancement. By using this Marin model, you agree to comply with all applicable law.