Downloads · 30 days
17
15% of all-time downloads
swesmith-coldstart-rl-seqnorm-tis-pym2t-75-8B
laion/swesmith-coldstart-rl-seqnorm-tis-pym2t-75-8B
swesmith-coldstart-rl-seqnorm-tis-pym2t-75-8B is a machine learning model from laion. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
RL (SkyRL / RLOO-N) fine-tune of laion/swesmith-coldstart-complete-lt32k-2ep-8B (Qwen3-8B) on DCAgent/exprptpymethods2test-large, with sequence-length-normalized loss (seqmeantokensumnormglobal) + Truncated Importance…
All-time downloads
116
Public
Parameters
8.2B
16.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.4 GB · 99%
At a glance
- Model type
- qwen3
- Access
- Public
- Created
- Jun 18, 2026
- Updated
- Sep 4, 2026
- SHA
- 5aea5ba3
Base models
Model card
From the Hugging Face model README
swesmith-coldstart-rl-seqnorm-tis-pym2t (AdamW, global_step_75)
RL (SkyRL / RLOO-N) fine-tune of laion/swesmith-coldstart-complete-lt32k-2ep-8B (Qwen3-8B) on
DCAgent/exp_rpt_pymethods2test-large, with sequence-length-normalized loss
(seq_mean_token_sum_norm_global) + Truncated Importance Sampling (cap 2.0), AdamW optimizer (lr 8e-6).
This is the AdamW optimizer reference twin of the Muon ablation
(swesmith-coldstart-rl-seqnorm-tis-muon-pym2t) — same recipe, optimizer is the only difference.
Exported at global_step_75 (the latest HF-merged export; the run reached step 79/80 before the
time-limited chain was stopped, with the latest resumable checkpoint at global_step_78).
Config: see rl_config.yaml. Training curves / parsed metrics: see training_logs/.
Training Traces
Training-time Daytona/Harbor rollouts: open-athena/swesmith-coldstart-rl-seqnorm-tis-pym2t
(the last episode of each trial — the rollouts the policy trained on).
- Type
- qwen3
- Created
- Jun 18, 2026
- Updated
- Sep 4, 2026