Downloads · 30 days
10
37% of all-time downloads
OpenMath-nemotron-7B-WSPO
wh-zhu/OpenMath-nemotron-7B-WSPO
OpenMath-nemotron-7B-WSPO is a machine learning model from wh-zhu. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
27
Public
Parameters
7.6B
15.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.2 GB · 100%
At a glance
- Model type
- qwen2
- Access
- Public
- Created
- May 25, 2025
- Updated
- May 25, 2025
- SHA
- fd39c032
Model card
From the Hugging Face model README
Performance:
Citation
@inproceedings{
zhu2025weaktostrong,
title={Weak-to-Strong Preference Optimization: Stealing Reward from Weak Aligned Model},
author={Wenhong Zhu and Zhiwei He and Xiaofeng Wang and Pengfei Liu and Rui Wang},
booktitle={The Thirteenth International Conference on Learning Representations},
year={2025},
url={https://openreview.net/forum?id=f7KxfUrRSb}
}
- Type
- qwen2
- Created
- May 25, 2025
- Updated
- May 25, 2025