Downloads · 30 days
18
13% of all-time downloads
Liang0223/Qwen-2.5-Math-1.5B-DPO
Qwen-2.5-Math-1.5B-DPO is a text generation model from Liang0223. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model was presented in the paper On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.
Downloads · 30 days
18
13% of all-time downloads
All-time downloads
142
Public
Parameters
1.5B
21.6 GB on disk
Likes
1
Public
Click a slice to open those files.
.pt18.5 GB · 86%
From the Hugging Face model README
This model was presented in the paper On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.
Code: https://github.com/yongliang-wu/DFT?tab=readme-ov-file