Downloads · 30 days
464
68% of all-time downloads
OLMo-2-1B
sbordt/OLMo-2-1B
OLMo-2-1B is a machine learning model from sbordt. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a research variant of OLMo-2-0425-1B. The model serves as a baseline for comparisons with OLMo-2-1B-Exp.
All-time downloads
683
Public
Parameters
1.5B
5.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.9 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- olmo2
- Access
- Public
- Created
- Sep 25, 2025
- Updated
- Mar 28, 2026
- SHA
- 28ff8e2b
Model card
From the Hugging Face model README
Model Card for OLMo-2-1B-7x
This model is a research variant of OLMo-2-0425-1B. The model serves as a baseline for comparisons with OLMo-2-1B-Exp.
This model is trained at 7x Chinchilla. We linearly decayed the learning rate of the OLMo-2-0425-1B checkpoint at gradient step 90.000 to zero over 10.000 gradient steps.
The model is described in the paper "Train Once, Answer All: Many Pretraining Experiments for the Cost of One".
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
olmo = AutoModelForCausalLM.from_pretrained("sbordt/OLMo-2-1B")
tokenizer = AutoTokenizer.from_pretrained("sbordt/OLMo-2-1B")
- Type
- olmo2
- License
- apache-2.0
- Languages
- en
- Created
- Sep 25, 2025
- Updated
- Mar 28, 2026