opus-high-v2-record

opus-high-v2 — run record

Claude Code / claude-opus-5 @ effort high, 100 h, 2026-08-19 19:35Z → 2026-08-23 23:35Z. Checkpoints: agentic-ptb/opus-high-v2.h*. Index: agentic-ptb/INDEX.

Correction, 2026-08-24. An earlier version of this card said this cell's weight lever was "blocked by infrastructure", citing "90 × HTTP 408" in the GRPO logs. That was wrong. Those matched substrings of sandbox IDs and job UUIDs (48a48408, 44082826), not HTTP status codes. GRPO ran: batches filled to 62/64 (96.9%), a trainer step completed, and 70 of 154 rollouts ended agent_completed. The corrected account is below.

Read this before using the numbers

The cell's headline is 14.5% → 33.1% on swe-bench-verified (+18.5pp, n=248, p<0.001) — but no tensor was trained into it. The submitted artifact is Qwen/Qwen3.5-9B-Base with two config files corrected (an added generation_config.json carrying eos_token_id, and tokenizer_config.json's eos_token). Five SFT runs were measured and all five regressed.

Why it stopped changing weights at hour 12. The arm chose GRPO as its weight lever, ran it, and abandoned it on measured reward sparsity — its own note (NOTES.md): "Grad norm is small (0.0012) and reward density is low: 5 solved of 154 rollouts = 3.2%... Most groups are therefore all-zero and dropped by the zero_advantage filter, so each step moves the policy very little." SandboxError was 39/154 (25%), real but not the cause; the same broker served this cell's evaluations throughout.

An open thread. Hours earlier the arm had recorded that the eos fix raised reward density to 15–19% on swesmith, and the live RL run measured 3.2% "against the 18.2% measured on swesmith alone". It flagged the discrepancy, wrote "check the per-source split before the next block" — and never did. So the 3.2% may be a misconfiguration (source mix, or the eos fix not reaching the RL rollout path) rather than a property of the task set. rl-failure/ holds the raw logs.

Every weight checkpoint here is from h004–h012; there is no progress curve across the remaining 88 hours, which were spent on harness work, packaging and measurement. keep_last = 2/4 evicted intermediate checkpoints during training and ckpt/sft-v1 did not survive.

Ran under goal rules v6 (goal-v6-as-run.md). v7 was written in response to this cell.