halluci-mate-v2c

halluci-mate v2c

DPO fine-tune of jspaulsen/halluci-mate-v2b on Stockfish-vs-model preference pairs. Same Qwen3-0.6B architecture, same custom ~1,800-token UCI tokenizer; the policy was nudged to prefer the moves Stockfish endorses over the moves v2b actually played in not-yet-lost positions.

Source: https://github.com/jspaulsen/halluci-mate

Training data

11,491 preference pairs derived from a 10,000-game v2b-vs-Stockfish run (skill 5, depth 12) using the halluci-mate eval harness:

scripts/eval.py export-dpo <run> --flavor quality \
  --require-consequential --exclude-repetition

• Quality threshold: centipawn loss > 200.
• --require-consequential drops moves played from positions already evaluated as lost (eval-before < -800 cp). Blunders in already-lost endgames teach the model to chase swindle lines that don't generalize.
• --exclude-repetition drops moves that recur within the same game. Stockfish flags forced-repetition draws as blunders even when repetition is the only drawing line.

Training recipe

scripts/train_dpo.py via TRL's DPOTrainer:

The 2-epoch run plateaus on eval_rewards/accuracies around step 200 while margins keep growing through step 352 — and on vs-Stockfish the late checkpoints regress on blunder rate (especially endgame and lost positions) despite a small further gain on tactical_oversight. Step 200 is the behavioral sweet spot; it is the checkpoint published here.

Held-out eval at end of training (step 200)

vs-Stockfish (skill 5, depth 12, alternating colors, --sf-analyze)

The v2b numbers come from 10,000 games, so its CIs are much tighter than v2c's 100-game eval. score_rate is within the n=100 noise band; per-move quality improvements on tactical_oversight, blunder rate, and CPL tail are above noise and consistent with the DPO objective.

License

MIT, matching the v2b base.