PrAg-PO-DeepSeek-R1-Distill-Qwen-1.5B-step1100

Model Card for PrAg-PO DeepSeek-R1-Distill-Qwen-1.5B step1100

If you are using the model, a star to our github repo would be really appreciated! 😊

This is the step 1100 checkpoint when training DeepSeek-R1-Distill-Qwen-1.5B on MATH Level-3-to-5 Dataset using PrAg-PO. The training procedure is outlined in the paper PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning.

Model Sources

• Repository 🤖: https://github.com/wenquanlu/PrAg-PO
• Paper 📝: PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning

Uses

This model is intended for mathematical reasoning tasks. It leverages prompt augmentation to generate reasoning traces under diverse templates, increasing rollout diversity and stability during RL training.

Results

<p align="center"> <img src="https://raw.githubusercontent.com/wenquanlu/prompt-augmentation-GRPO/master/imgs/table_result.png"> </p>

Citation

@misc{lu2026pragpopromptaugmentedpolicy,
      title={PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning}, 
      author={Wenquan Lu and Hai Huang and Enqi Liu and Randall Balestriero},
      journal={arXiv preprint arXiv:2602.03190},
      url={https://arxiv.org/abs/2602.03190},
      year={2026},
}