Downloads · 30 days
12
19% of all-time downloads
AlexWortega/ml-intern-moe100m-ufweb-en-step66035-10B-20260517-1222
ml-intern-moe100m-ufweb-en-step66035-10B-20260517-1222 is a text generation model from AlexWortega. Use it when you need the model to write or continue text. It is set up for pytorch. The card lists the license as apache-2.0.
This is an intermediate checkpoint from a 100B-token continuation pretrain of the ml-intern-moe100m-ufweb-en-1B model. The full run is targeted at 100B tokens (12-day wall on 4× V100 SXM2); this snapshot is at step 66…
Downloads · 30 days
12
19% of all-time downloads
All-time downloads
64
Public
Parameters
229M
917 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors917 MB · 99%
From the Hugging Face model README
This is an intermediate checkpoint from a 100B-token continuation pretrain
of the ml-intern-moe100m-ufweb-en-1B
model. The full run is targeted at 100B tokens (12-day wall on 4× V100 SXM2);
this snapshot is at step 66 035 (≈ 10.82 B tokens consumed total counting the
1B and 10B warm-start phases).
model.py.ckpts_100b/step_66035.pt (EMA shadow extracted for inference)Reproducibility bundle (TASK / PLAN / RESULTS / EVAL / train+eval logs) is in
this repo. The full final ckpt at 100B will land at
AlexWortega/ml-intern-moe100m-ufweb-en-100B-* when training completes
(~10 days away).
EVAL_10B.md in this repo), trails
on lambada_openai due to limited training data variety.