Downloads · 30 days
6
6% of all-time downloads
qbmrg858/dpo-qwen-cot-on-sft-v2-merged-a1
dpo-qwen-cot-on-sft-v2-merged-a1 is a text generation model from qbmrg858. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a DPO fine-tuned version built on top of a merged SFT model.
Downloads · 30 days
6
6% of all-time downloads
All-time downloads
93
Public
Parameters
4B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
This model is a DPO fine-tuned version built on top of a merged SFT model.