Downloads · 30 days
0
nanochat-d24-2026-02-02
ChrisMcCormick/nanochat-d24-2026-02-02
nanochat-d24-2026-02-02 is a machine learning model from ChrisMcCormick. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Raw weights from the training run for PR 492
Access
Public
Updated Feb 8, 2026
Repo size
10 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt10 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Feb 2, 2026
- Updated
- Feb 8, 2026
- SHA
- 2ccf4232
Model card
From the Hugging Face model README
Raw weights from the training run for PR 492
Results:
Step 16704 | CORE metric: 0.2633
Total training time: 179.44m
Minimum validation bpb: 0.753336
Trained with:
( cat ./nanochat/gpt.py; cat ./nanochat/optim.py; cat ./nanochat/dataloader.py; cat ./scripts/base_train.py; echo -e "\n\n===== TRAINING OUTPUT =====\n\n"; OMP_NUM_THREADS=1 torchrun --standalone --nproc_per_node=8 -m scripts.base_train -- \
--depth=24 \
--run=d24-feb01 \
--model-tag=d24_feb01 \
--device-batch-size=16 \
--sample-every=-1 \
--save-every=-1 \
--core-metric-max-per-task=-1 \
--core-metric-every=3000 \
--target-param-data-ratio=12 ) \
2>&1 | tee ./logs/speedrun_d24_feb01-rope_chunk_mlp_lr_1x2x.log
- License
- mit
- Created
- Feb 2, 2026
- Updated
- Feb 8, 2026