Skip to content

shubhamrgandhi

Qwen3-4B-DPO-prm-pairs

shubhamrgandhi/Qwen3-4B-DPO-prm-pairs

Qwen3-4B-DPO-prm-pairs is a text generation model from shubhamrgandhi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

DPO fine-tune of Qwen/Qwen3-4B-Instruct-2507 on preference pairs of supervisor feedback for an LLM coding agent. The task the model is trained toward: given an agent's trajectory, produce trajectory-level error analys…

Downloads · 30 days

4

1% of all-time downloads

All-time downloads

486

Public

Parameters

4B

8.1 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors8 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
qwen3
Access
Public
Created
Aug 20, 2026
Updated
Aug 20, 2026
SHA
843c1753

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3
License
apache-2.0
Created
Aug 20, 2026
Updated
Aug 20, 2026