Downloads · 30 days
4
10% of all-time downloads
olmo3-190m-zh-nano
miaota/olmo3-190m-zh-nano
olmo3-190m-zh-nano is a machine learning model from miaota. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
为零基础 AI 大模型研发训练营（llm001）L04 Nano 模型（26M 参数，20 步测试训练）。
All-time downloads
39
Public
Parameters
22M
87.9 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors87.9 MB · 96%
At a glance
- License
- apache-2.0
- Model type
- olmo3
- Access
- Public
- Created
- May 9, 2026
- Updated
- May 9, 2026
- SHA
- 49519a8e
Base models
Model card
From the Hugging Face model README
OLMo3-190M-zh-nano
为零基础 AI 大模型研发训练营（llm001）L04 Nano 模型（26M 参数，20 步测试训练）。
模型配置（Full 的等比缩小版）
| 参数 | Full (190M) | Nano (26M) |
|---|---|---|
| hidden_size | 768 | 192 |
| num_layers | 12 | 6 |
| num_heads | 12 | 3 |
| intermediate_size | 3072 | 768 |
| vocab_size | 48000 | 48000 |
训练配置
- 数据：cmz1024/llm101-olmo3-zh-demo-data (500M tokens)
- 训练：H100, max_steps=20, bs=32×4=128, lr=1e-3, bf16
用法
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("cmz1024/olmo3-190m-zh-nano")
tok = AutoTokenizer.from_pretrained("cmz1024/olmo3-190m-zh-nano")
- Type
- olmo3
- License
- apache-2.0
- Languages
- zh
- Created
- May 9, 2026
- Updated
- May 9, 2026