Downloads · 30 days
13
3% of all-time downloads
r2egym_8b_rope_65k-step17
laion/r2egym_8b_rope_65k-step17
r2egym_8b_rope_65k-step17 is a text generation model from laion. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
RL-trained Qwen3-8B on R2EGym tasks (65k context with YaRN rope scaling, 17 steps).
All-time downloads
372
Public
Parameters
8.2B
16.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Mar 18, 2026
- Updated
- Sep 4, 2026
- SHA
- 4c25e029
Try a prompt
Base models
Model card
From the Hugging Face model README
r2egym_8b_rope_65k-step17
RL-trained Qwen3-8B on R2EGym tasks (65k context with YaRN rope scaling, 17 steps).
Training Details
| Parameter | Value |
|---|---|
| Base model | laion/GLM-4_7-r2egym_sandboxes-maxeps-131k-lc (Qwen3-8B SFT, long-context) |
| Dataset | R2EGym GPT5/Codex solved tasks (1,785 tasks) |
| Algorithm | RLOO-N (Leave-One-Out with neutral masking) |
| Learning rate | 3.0e-5 |
| Train batch size | 32 |
| Samples per prompt | 8 |
| Max episodes | 64 |
| Max generate length | 8,192 tokens |
| Max input tokens | 57,344 |
| Max model length | 65,536 |
| Rope scaling | YaRN (factor=4.0, original_max_pos_emb=32,768) |
| KL loss | Disabled |
| Reward shaping | Enabled (pass_ratio) |
| Staleness steps | 16 |
| Policy nodes | 2 (8 GPUs, FSDP2) |
| Inference engines | 20 (TP=1) |
| Training steps | 17 |
| Framework | BenSkyRL + Harbor |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("laion/r2egym_8b_rope_65k-step17")
tokenizer = AutoTokenizer.from_pretrained("laion/r2egym_8b_rope_65k-step17")
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Mar 18, 2026
- Updated
- Sep 4, 2026