Downloads · 30 days
17
19% of all-time downloads
GAIR/daVinci-origin-7B
daVinci-origin-7B is a machine learning model from GAIR. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
📝 A note on naming: Across different versions of the paper, this model has appeared under slightly different names. The model released here as daVinci-origin-7B is referred to as S7B in some versions of the paper — t…
Downloads · 30 days
17
19% of all-time downloads
All-time downloads
91
Public
Parameters
7.6B
15.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.2 GB · 100%
From the Hugging Face model README
📝 A note on naming: Across different versions of the paper, this model has appeared under slightly different names. The model released here as
daVinci-origin-7Bis referred to asS7Bin some versions of the paper — they refer to the same artifact.
daVinci-origin-7B is a fully transparent, 7-billion parameter foundation model trained from scratch. It serves as a "clean-room" baseline for the research paper Data Darwinism -- Part1: Unlocking the Value of Scientific Data for Pre-training.
Unlike most open-source models, daVinci-origin-7B was explicitly trained on a dataset strictly excluding scientific content (books and research papers). This unique design allows researchers to unambiguously attribute performance gains to specific domain data injection strategies during continued pre-training.