Downloads · 30 days
4
5% of all-time downloads
Chiaki111/qwen3-4b-structured-dpo-merged9-v1
qwen3-4b-structured-dpo-merged9-v1 is a text generation model from Chiaki111. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library.
Downloads · 30 days
4
5% of all-time downloads
All-time downloads
86
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library.
This repository contains the full-merged 16-bit weights. No adapter loading is required.
This DPO model was trained on top of a structured-output SFT LoRA model
(r=16, alpha=32, target_modules=[q_proj, k_proj, v_proj, o_proj]).
The SFT stage was used to improve JSON/YAML/XML formatting stability before applying preference optimization.