Downloads · 30 days
17
20% of all-time downloads
swesmith_8b_rope_65k-step37
laion/swesmith_8b_rope_65k-step37
swesmith_8b_rope_65k-step37 is a text generation model from laion. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
RL-trained Qwen3-8B on SWEsmith tasks (65k context with YaRN rope, 37 steps, LR=2e-5, Dr.GRPO with sequencemean loss, epscliphigh=0.28).
All-time downloads
87
Public
Parameters
8.2B
16.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Mar 18, 2026
- Updated
- Mar 18, 2026
- SHA
- 027da692
Try a prompt
Base models
Model card
From the Hugging Face model README
swesmith_8b_rope_65k-step37
RL-trained Qwen3-8B on SWEsmith tasks (65k context with YaRN rope, 37 steps, LR=2e-5, Dr.GRPO with sequence_mean loss, eps_clip_high=0.28).
Training Details
- Base model: laion/GLM-4_7-r2egym_sandboxes-maxeps-131k-lc
- Training method: drgrpo
- Framework: BenSkyRL + Harbor
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("laion/swesmith_8b_rope_65k-step37")
tokenizer = AutoTokenizer.from_pretrained("laion/swesmith_8b_rope_65k-step37")
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Mar 18, 2026
- Updated
- Mar 18, 2026