Skip to content

qbmrg858

dpo-qwen-cot-on-sft-v2-merged-a1

qbmrg858/dpo-qwen-cot-on-sft-v2-merged-a1

dpo-qwen-cot-on-sft-v2-merged-a1 is a text generation model from qbmrg858. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This model is a DPO fine-tuned version built on top of a merged SFT model.

Downloads · 30 days

6

6% of all-time downloads

All-time downloads

93

Public

Parameters

4B

16.1 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors8 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
qwen3
Access
Public
Created
Mar 1, 2026
Updated
Mar 1, 2026
SHA
fb7eecbc

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3
License
apache-2.0
Languages
en
Created
Mar 1, 2026
Updated
Mar 1, 2026