Downloads · 30 days
21
5% of all-time downloads
Qwen3-32B-R2EGYM-256-3epochs
laion/Qwen3-32B-R2EGYM-256-3epochs
Qwen3-32B-R2EGYM-256-3epochs is a text generation model from laion. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This model is a reinforcement learning fine-tuned version of Qwen/Qwen3-32B, trained using the SkyRL framework with fully asynchronous PPO on coding and reasoning tasks from the R2EGYM benchmark.
All-time downloads
430
Public
Parameters
32.8B
65.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors65.5 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Mar 6, 2026
- Updated
- Sep 4, 2026
- SHA
- 54ebd8ab
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-32B-R2EGYM-256-3epochs
This model is a reinforcement learning fine-tuned version of Qwen/Qwen3-32B, trained using the SkyRL framework with fully asynchronous PPO on coding and reasoning tasks from the R2EGYM benchmark.
Training Details
Framework
- Training Framework: SkyRL (fully async PPO)
- Parallelism Strategy: FSDP2 with CPU offload
- Agent: Terminus-2 (terminal-based coding agent with thinking enabled)
Dataset
- Dataset: open-athena/r2egym_gpt5_codex_solved_tasks_256_subset
- Number of tasks: 256
- Evaluation set: OpenThoughts-TB-dev (70 tasks)
Hyperparameters
| Parameter | Value |
|---|---|
| Epochs | 3 |
| Total steps | 12 (4 steps/epoch) |
| Learning rate | 1e-5 |
| Weight decay | 0.0 |
| Train batch size | 64 |
| Micro train batch size per GPU | 1 |
| Advantage estimator | rloo_n |
| KL loss | disabled |
| Samples per prompt | 8 |
| Max prompt length | 2,048 |
| Max generate length | 30,720 |
| RoPE scaling | yarn (factor=4.0, original_max_position_embeddings=32,768) |
Infrastructure
| Component | Configuration |
|---|---|
| Policy nodes | 4 nodes x 4 GPUs |
| Reference model nodes | 4 nodes x 4 GPUs |
| Inference engines | 26 (tensor parallelism = 2) |
| Parallel generation workers | 96 |
| Concurrent sandbox trials | 96 |
| Total training nodes | 17 |
Training Notes
- Training was resumed from a step-9 checkpoint
- The model uses Terminus-2, a terminal-based coding agent that interacts with sandboxed Docker environments to solve programming tasks
- Thinking mode was enabled during training (
--enable_thinking)
Usage
This model can be used as a drop-in replacement for Qwen3-32B with improved coding and reasoning capabilities.
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("laion/Qwen3-32B-R2EGYM-256-3epochs")
tokenizer = AutoTokenizer.from_pretrained("laion/Qwen3-32B-R2EGYM-256-3epochs")
- Task
- Text Generation
- Type
- qwen3
- License
- apache-2.0
- Created
- Mar 6, 2026
- Updated
- Sep 4, 2026