Downloads · 30 days
0
gemma-4-26B-A4B-DeepScaleR-hard-s42-fullckpt-step47
JWei05/gemma-4-26B-A4B-DeepScaleR-hard-s42-fullckpt-step47
gemma-4-26B-A4B-DeepScaleR-hard-s42-fullckpt-step47 is a machine learning model from JWei05. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
DAPO/GRPO RL full checkpoint produced with a verl FSDP2 fork. This is not an inference-only export: it contains everything needed to resume training on another cluster.
Access
Public
Updated Sep 2, 2026
Repo size
305 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt305 GB · 100%
At a glance
- License
- gemma
- Access
- Public
- Created
- Sep 2, 2026
- Updated
- Sep 2, 2026
- SHA
- 1af4ed7f
Base models
Model card
From the Hugging Face model README
Gemma 4 26B-A4B — DeepScaleR hard band — seed 42 — full resumable checkpoint (global step 47)
DAPO/GRPO RL full checkpoint produced with a verl FSDP2 fork. This is not an inference-only export: it contains everything needed to resume training on another cluster.
actor/model_world_size_8_rank_{0..7}.pt— FSDP2-sharded model weights.actor/optim_world_size_8_rank_{0..7}.pt— Adam optimizer state shards.actor/extra_state_world_size_8_rank_{0..7}.pt— RNG and LR-scheduler state.actor/huggingface/— tokenizer and model config.data.pt— StatefulDataLoader cursor (exact dataset position).validation_early_stopping.json— early-stopping state (best mean@16 0.21104 @ step 40).
Resume
Sharded at world_size=8, so resume on 8 GPUs with the same FSDP layout, keeping the
data paths, shuffle seed, batch size, and response count unchanged:
RESUME_MODE=resume_path trainer.resume_from_path=<local_dir>/global_step_47
- License
- gemma
- Created
- Sep 2, 2026
- Updated
- Sep 2, 2026