Downloads · 30 days
5
42% of all-time downloads
leejason2025/magic-run100x
magic-run100x is a machine learning model from leejason2025. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
GPT-2 Small core (85.7M params, vocab 276, 512 positions) trained from scratch on ~1B tokens: 900M FineWeb-Edu (byte-level arithmetic-safe tokenizer) + 25M x 4 synthetic arithmetic evidence families (widened-v2 spec:…
Downloads · 30 days
5
42% of all-time downloads
All-time downloads
12
Public
Parameters
85.7M
343 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors343 MB · 100%
From the Hugging Face model README
GPT-2 Small core (85.7M params, vocab 276, 512 positions) trained from scratch on ~1B tokens: 900M FineWeb-Edu (byte-level arithmetic-safe tokenizer) + 25M x 4 synthetic arithmetic evidence families (widened-v2 spec: starts 0-999, mult 2-5, addsub 1-99; 300k distinct programs/family). prod_v1 config: batch 64, lr 3e-4 linear decay, warmup 20, wd 0.01, eps_root 1e-2, seed 0, 30,518 steps, single H100. Final checkpoint step_30517 exported via tools/export_checkpoint.py. Held-out (ADD->MULTIPLY) answer loss: 2.33 (chance ~5.62). Project: Stage-Resolved Data Attribution (MathaMAGICal / algoverse-jpdv).