Downloads · 30 days
43
20% of all-time downloads
Qwen2.5-1.5B-Instruct-dpo
azherali/Qwen2.5-1.5B-Instruct-dpo
Qwen2.5-1.5B-Instruct-dpo is a text generation model from azherali. Use it when you need the model to write or continue text. It is set up for transformers.
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct. It has been trained using TRL.
All-time downloads
211
Public
Parameters
1.5B
6.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen2
- Access
- Public
- Created
- Jan 8, 2026
- Updated
- Jan 8, 2026
- SHA
- c5fb7110
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Card for qwen25-dpo
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct. It has been trained using TRL.
Quick start
from transformers import pipeline
question = "Explain diabetes simply"
generator = pipeline("text-generation", model="azherali/Qwen2.5-1.5B-Instruct-dpo", device="cuda")
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
print(output["generated_text"])
Training procedure
This model was trained with DPO, a method introduced in Direct Preference Optimization: Your Language Model is Secretly a Reward Model.
Framework versions
- TRL: 0.26.2
- Transformers: 4.57.3
- Pytorch: 2.8.0+cu126
- Datasets: 4.4.1
- Tokenizers: 0.22.1
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- Created
- Jan 8, 2026
- Updated
- Jan 8, 2026