Skip to content

WattsIshaan

OLMo-60m-192B-adamw-cosine-10percent

WattsIshaan/OLMo-60m-192B-adamw-cosine-10percent

OLMo-60m-192B-adamw-cosine-10percent is a machine learning model from WattsIshaan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-4.0.

OLMo-60M checkpoint pretrained with AdamW optimizer and cosine LR schedule on 192B tokens from DCLM. This checkpoint is for 90% of the training steps (670000 steps at 256 bsz), and can be annealed for the remaining 10…

Downloads · 30 days

5

24% of all-time downloads

All-time downloads

21

Public

Repo size

1.6 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt1.6 GB · 100%

At a glance

License
cc-by-4.0
Access
Public
Created
Sep 12, 2026
Updated
Sep 12, 2026
SHA
3aad3a3f
License
cc-by-4.0
Created
Sep 12, 2026
Updated
Sep 12, 2026