Skip to content

maru-miya

dpo-qwen-cot-merged_v27

maru-miya/dpo-qwen-cot-merged_v27

dpo-qwen-cot-merged_v27 is a text generation model from maru-miya. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library.

Downloads · 30 days

5

7% of all-time downloads

All-time downloads

68

Public

Parameters

4B

8.1 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors8 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
qwen3
Access
Public
Created
Feb 7, 2026
Updated
Feb 7, 2026
SHA
3985781d

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3
License
apache-2.0
Languages
en
Created
Feb 7, 2026
Updated
Feb 7, 2026