Downloads · 30 days
10
10% of all-time downloads
daVinci-origin-3B
GAIR/daVinci-origin-3B
daVinci-origin-3B is a machine learning model from GAIR. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
📝 A note on naming: Across different versions of the paper, this model has appeared under slightly different names. The model released here as daVinci-origin-3B is referred to as S3B in some versions of the paper — t…
All-time downloads
97
Public
Parameters
3.4B
6.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors6.8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jan 28, 2026
- Updated
- Apr 16, 2026
- SHA
- 7b75b296
Model card
From the Hugging Face model README
daVinci-origin-3B
📝 A note on naming: Across different versions of the paper, this model has appeared under slightly different names. The model released here as
daVinci-origin-3Bis referred to asS3Bin some versions of the paper — they refer to the same artifact.
daVinci-origin-3B is a fully transparent, 3-billion parameter foundation model trained from scratch. It serves as a "clean-room" baseline for the research paper Data Darwinism -- Part1: Unlocking the Value of Scientific Data for Pre-training.
Unlike most open-source models, daVinci-origin-3B was explicitly trained on a dataset strictly excluding scientific content (books and research papers). This unique design allows researchers to unambiguously attribute performance gains to specific domain data injection strategies during continued pre-training.
- Type
- qwen2
- License
- apache-2.0
- Created
- Jan 28, 2026
- Updated
- Apr 16, 2026