Downloads · 30 days
0
cse251b-baseline-day3
EthanChen/cse251b-baseline-day3
cse251b-baseline-day3 is a machine learning model from EthanChen. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Day-3 baseline checkpoint for UCSD CSE 251B Spring 2026 NanoGPT competition.
Access
Public
Updated Apr 27, 2026
Repo size
618 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt618 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Apr 27, 2026
- Updated
- Apr 27, 2026
- SHA
- 5331d968
Model card
From the Hugging Face model README
CSE 251B NanoGPT Baseline (Day 3)
Day-3 baseline checkpoint for UCSD CSE 251B Spring 2026 NanoGPT competition.
- 50.93M params (n_layer=8, n_head=8, n_embd=512, block_size=1024)
- Trained on FineWeb-Edu (~983M tokens, 10k iters, AdamW, cosine LR 6e-4 → 6e-5)
- val PPL on contest val.bin: 41.72
This is a snapshot for the milestone report; not the final submission.
- License
- mit
- Created
- Apr 27, 2026
- Updated
- Apr 27, 2026