Downloads · 30 days
3
11% of all-time downloads
qwen3-fgrpo-training
silentspuck/qwen3-fgrpo-training
qwen3-fgrpo-training is a machine learning model from silentspuck. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Training Qwen model using F-GRPO (Focal Loss-enhanced Group Relative Policy Optimization).
All-time downloads
28
Public
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.py23.9 KB · 85%
At a glance
- Access
- Public
- Created
- Feb 16, 2026
- Updated
- Feb 16, 2026
- SHA
- 5bf67afa
Model card
From the Hugging Face model README
F-GRPO Training for Qwen Math Reasoning
Training Qwen model using F-GRPO (Focal Loss-enhanced Group Relative Policy Optimization).
Based on Paper
"F-GRPO: Don't Let Your Policy Learn the Obvious and Forget the Rare" (Feb 2026)
Method
F-GRPO improves upon standard GRPO by:
- Down-weighting easy prompts (high success rate)
- Up-weighting hard prompts (low success rate)
- Using Focal Loss-inspired scaling:
advantage_fgrpo = (1 - success_rate)^γ * advantage_grpo
Configuration
- Model: Qwen/Qwen2.5-3B (fits T4 Small 16GB)
- Dataset: DeepMath-103K or GSM8K
- Steps: 50 (minimal training, Raschka's finding)
- Hardware: T4 Small GPU (16GB VRAM)
Training Script
train_fgrpo_trl.py- Main training script using TRL GRPOTrainer
Results Expected
Based on paper (Qwen2.5-7B):
- pass@256: 64.1 → 70.3 (+6.2 points)
- No extra compute cost
Usage
This Space automatically runs training on startup. Results are pushed to silentspuck/fgrpo-qwen-math-test.
- Created
- Feb 16, 2026
- Updated
- Feb 16, 2026