Downloads · 30 days
9
5% of all-time downloads
qwen3-4b-dpo-qwen-cot-merged
Yurori/qwen3-4b-dpo-qwen-cot-merged
qwen3-4b-dpo-qwen-cot-merged is a text generation model from Yurori. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library. This repository contains the full-merged 16-bit weights. No adapter loading is requ…
All-time downloads
179
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Mar 1, 2026
- Updated
- Mar 1, 2026
- SHA
- 81539206
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
qwen3-4b-dpo-qwen-cot-merged
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library. This repository contains the full-merged 16-bit weights. No adapter loading is required.
Training Configuration
- Base model: Qwen/Qwen3-4B-Instruct-2507
- Method: DPO
- Epochs: 1
- Learning rate: 1e-07
- Beta: 0.1
- Max sequence length: 1024
- LoRA Config: r=8, alpha=16 (merged into base)
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Mar 1, 2026
- Updated
- Mar 1, 2026