Skip to content

Ran21050

qwen3-4b-dpo-qwen-cot-merged-lora-param-tuned

Ran21050/qwen3-4b-dpo-qwen-cot-merged-lora-param-tuned

qwen3-4b-dpo-qwen-cot-merged-lora-param-tuned is a text generation model from Ran21050. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library.

Downloads · 30 days

0

Access

Public

Updated Feb 8, 2026

Repo size

540 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors529 MB · 97%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Access
Public
Created
Feb 8, 2026
Updated
Feb 8, 2026
SHA
70f4d39b

Try a prompt

Base models

Task
Text Generation
Library
transformers
License
apache-2.0
Languages
en
Created
Feb 8, 2026
Updated
Feb 8, 2026