Downloads · 30 days
12
3% of all-time downloads
code-critic-model/Qwen3-4B-SFT-DPO-4B-1409i-beta0.15-sft0.3-lr1e-6-bs32-ep3-step-120
Qwen3-4B-SFT-DPO-4B-1409i-beta0.15-sft0.3-lr1e-6-bs32-ep3-step-120 is a text generation model from code-critic-model. Use it when you need the model to write or continue text. It is set up for transformers.
Not used in the paper. This is a development checkpoint kept so that existing links keep working. The critics reported in Steer, Don't Solve are listed on the organization page; the released DPO critic is Qwen3-4B-Cri…
Downloads · 30 days
12
3% of all-time downloads
All-time downloads
445
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
Not used in the paper. This is a development checkpoint kept so that existing links keep working. The critics reported in Steer, Don't Solve are listed on the organization page; the released DPO critic is Qwen3-4B-Critic-SFT-DPO.
Final checkpoint (step 120, end of epoch 3) of the DPO run whose step-80 checkpoint was released as Qwen3-4B-Critic-SFT-DPO. Same initialization, data, and hyperparameters (beta 0.15, SFT weight 0.3, lr 1e-6, effective batch 32); only the number of steps differs. Held-out preference accuracy at step 120 was 0.65 versus 0.68 at step 80, and the step-80 checkpoint was selected for the paper.