Skip to content

WattsIshaan

OLMo-150m-120B-adamw-cosine-10percent

WattsIshaan/OLMo-150m-120B-adamw-cosine-10percent

OLMo-150m-120B-adamw-cosine-10percent is a machine learning model from WattsIshaan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-4.0.

OLMo-150M checkpoint pretrained with AdamW optimizer and cosine LR schedule on 120B tokens from DCLM. This checkpoint is for 90% of the training steps (415000 steps at 256 bsz), and can be annealed for the remaining 1…

Downloads · 30 days

7

32% of all-time downloads

All-time downloads

22

Public

Repo size

3.2 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt3.2 GB · 100%

At a glance

License
cc-by-4.0
Access
Public
Created
Sep 12, 2026
Updated
Sep 12, 2026
SHA
f9e0a9f6
License
cc-by-4.0
Created
Sep 12, 2026
Updated
Sep 12, 2026