Downloads · 30 days
2
2% of all-time downloads
dpo-qwen-cot-merged
ryo25/dpo-qwen-cot-merged
dpo-qwen-cot-merged is a text generation model from ryo25. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of BASEMODEL using Direct Preference Optimization (DPO) via the Unsloth library.
All-time downloads
84
Public
Parameters
4B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Feb 4, 2026
- Updated
- Feb 4, 2026
- SHA
- d5aa2ef4
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
TITLE
This model is a fine-tuned version of BASE_MODEL using Direct Preference Optimization (DPO) via the Unsloth library.
This repository contains the full-merged 16-bit weights. No adapter loading is required.
Training Configuration
- Base model: BASE_MODEL
- Method: DPO (Direct Preference Optimization)
- Epochs: EPOCHS
- Learning rate: LR
- Beta: BETA
- Max sequence length: MAXLEN
Sources & License
- Training Data: DATASET
- Compliance: Users must follow the original base model's license terms.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Feb 4, 2026
- Updated
- Feb 4, 2026