Downloads · 30 days
13
9% of all-time downloads
aryan-kolapkar/Qwen-2.5_1.5b_MATH_GSM8K_SFT10_DPO3
Qwen-2.5_1.5b_MATH_GSM8K_SFT10_DPO3 is a text generation model from aryan-kolapkar. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model extends Qwen2.5-Math-1.5B by training in two stages:
Downloads · 30 days
13
9% of all-time downloads
All-time downloads
150
Public
Parameters
1.5B
3.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
This model extends Qwen2.5-Math-1.5B by training in two stages:
| Model | Pass@1 |
|---|---|
| Base Qwen2.5-Math-1.5B | ~54% |
| SFT checkpoint | ~67.5% |
| After SFT + DPO (this model) | ~70% |
Evaluation was run on the GSM8K test split with:
temperature=0.1, top_p=1.0, greedy final answer extraction.
<think> and <answer> blocks