PrAg-PO-Qwen3-1.7b-step720

Model Card for PrAg-PO Qwen3-1.7B step720

If you are using the model, a star to our github repo would be really appreciated! 😊

This is the step 720 checkpoint when training Qwen3-1.7B on MATH Level-3-to-5 Dataset using PrAg-PO. The training procedure is outlined in the paper PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning.

Model Sources

• Repository 🤖: https://github.com/wenquanlu/PrAg-PO
• Paper 📝: PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning

Uses

This model is intended for mathematical reasoning tasks. It leverages prompt augmentation to generate reasoning traces under diverse templates, increasing rollout diversity and stability during RL training.

Results

<p align="center"> <img src="https://raw.githubusercontent.com/wenquanlu/prompt-augmentation-GRPO/master/imgs/table_result.png"> </p>

Citation

@misc{lu2026pragpopromptaugmentedpolicy,
      title={PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning}, 
      author={Wenquan Lu and Hai Huang and Enqi Liu and Randall Balestriero},
      journal={arXiv preprint arXiv:2602.03190},
      url={https://arxiv.org/abs/2602.03190},
      year={2026},
}