Downloads · 30 days
114
1% of all-time downloads
OpenSeek-Small-v1-SFT
BAAI/OpenSeek-Small-v1-SFT
OpenSeek-Small-v1-SFT is a machine learning model from BAAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
We adopt the Octothinker to build strong reasoning foundations. Our model's training consists of two phases: a mid-training stable phase on 200 billion tokens from a mathematical corpus, followed by a 20 billion token…
All-time downloads
20.5K
Public
Parameters
1.6B
3.2 GB on disk
Likes
8
Public
Repo makeup
Click a slice to open those files.
.safetensors3.2 GB · 100%
At a glance
- Model type
- deepseek_v3
- Access
- Public
- Created
- Aug 25, 2025
- Updated
- Sep 8, 2025
- SHA
- 1515c184
Base models
Model card
From the Hugging Face model README
OpenSeek-Small-v1-SFT Documentation
Overview
We adopt the Octothinker to build strong reasoning foundations. Our model's training consists of two phases: a mid-training stable phase on 200 billion tokens from a mathematical corpus, followed by a 20 billion token decay phase. Subsequently, we fine-tune the model on the Infinity-Instruct dataset to achieve superior instruction-following capabilities. This model is open-sourced as a baseline for future experiments, such as enhancing the reasoning capabilities of small models through reinforcement learning. The model architecture is the same as the OpenSeek-Small-v1 model.
Evaluation
| Metric | GSM8K | MATH-500 | Minerva Math | OlympiadBench | Avg. |
|---|---|---|---|---|---|
| Pass@1 | 20.698 | 13.100 | 3.470 | 2.741 | 10.002 |
| Pass@4 | 41.768 | 19.100 | 8.415 | 4.997 | 18.570 |
| Pass@8 | 51.838 | 19.599 | 11.680 | 5.185 | 22.075 |
License
- Type
- deepseek_v3
- Created
- Aug 25, 2025
- Updated
- Sep 8, 2025