Downloads · 30 days
0
procmarco/fpabl1-seed-ckpt
fpabl1-seed-ckpt is a machine learning model from procmarco. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
FP-ABL-1 seed checkpoint: procmarco/pina-500m-ckpt at step 17520 (9.186B tokens) with tokenoffset reset to 0 so both ablation arms resume the fresh 5B arm datasets from shard 0 while keeping model+optimizers+step. Sch…
Downloads · 30 days
0
Access
Public
Updated Jul 7, 2026
Repo size
4.6 GB
Likes
0
Public
Click a slice to open those files.
.pt4.6 GB · 100%
From the Hugging Face model README
FP-ABL-1 seed checkpoint: procmarco/pina-500m-ckpt at step 17520 (9.186B tokens) with token_offset reset to 0 so both ablation arms resume the fresh 5B arm datasets from shard 0 while keeping model+optimizers+step. Schedule is constant (plateau, no anneal), so keeping step 17520 with TARGET_STEPS 27057 trains exactly +5B.