unmaj-qwen3-1p7b-math345-end

unmaj-qwen3-1p7b-math345 · end checkpoint (step 136)

Fine-tuned from Qwen/Qwen3-1.7B-Base with TTRL / un-GRPO-maj: no labels, trains against the model's own self-consistency majority over 12 rollouts.

• Training data: q1716523669/MATH-Level345 (8,740 problems, MATH levels 3-5)
• Eval: MATH-500 (500 prompts, pass@1, temperature 0.6)
• This checkpoint: step 136 of 136 (2 epochs) — the end one
• Its score: 0.6548

best is the step with the highest eval; end is step 136. Both are published because they answer different questions and the gap between them is a result in itself. The sibling repo is unmaj-qwen3-1p7b-math345-best.

Hyperparameters

Effective batch 128 prompts per optimizer step, lr 3e-6, 2 epochs, 12 generations per prompt, 3072-token completions, temperature 1.0 for rollouts and 0.6 for eval, beta 0, bnpo loss, scale_rewards group, seed 42.

Eval curve

Files for audit

• train.log — the complete training log this checkpoint came from
• eval_curve.csv — the table above, machine-readable
• run_config.json — resolved config as the trainer saw it

Code: williamium3000/trl-projects, branch n3-interaction-modes, projects/co-grpo-dp/.