Downloads · 30 days
0
0829_nanochat_checkpoints
guanning/0829_nanochat_checkpoints
0829_nanochat_checkpoints is a machine learning model from guanning. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Full intermediate checkpoint trajectories for three nanochat d24 pretraining runs.
Access
Public
Updated Sep 3, 2026
Repo size
1.3 TB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt1.3 TB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026
- SHA
- 17f0eca5
Model card
From the Hugging Face model README
nanochat d24 training checkpoints (2026-08-29)
Full intermediate checkpoint trajectories for three nanochat d24 pretraining runs.
| folder | run | steps saved | model_*.pt |
|---|---|---|---|
d24/ | base | every 50 steps, up to 5568 | 112 |
d24_6shard_10ep/ | 6-shard, 10 epochs | every 26 steps, up to 2590 | 100 |
d24_13shard_10ep/ | 13-shard, 10 epochs | every 56 steps, up to 5600 | 100 |
Each folder contains:
model_XXXXXX.pt— model weights at that step (~3.9 GB each)optim_XXXXXX_rank{0..7}.pt— optimizer state at the final step (resume training)meta_XXXXXX.json— per-checkpoint metadataval_metrics.jsonl— validation curve for the run
- License
- mit
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026