Downloads · 30 days
11
14% of all-time downloads
Qwen2.5-0.5B-Instruct-Align-Anything-DPO
ll922/Qwen2.5-0.5B-Instruct-Align-Anything-DPO
Qwen2.5-0.5B-Instruct-Align-Anything-DPO is a machine learning model from ll922. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
DPO training is performed using the Align-Anything framework, with the PKU-Alignment/align-anything text-to-text dataset.
All-time downloads
80
Public
Parameters
494M
1000 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors988 MB · 98%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- May 27, 2025
- Updated
- May 27, 2025
- SHA
- 85d95d6c
Base models
Datasets
Model card
From the Hugging Face model README
DPO training is performed using the Align-Anything framework, with the PKU-Alignment/align-anything text-to-text dataset.
DPO training report: https://api.wandb.ai/links/nlp-amct/uifw66p5
- Type
- qwen2
- License
- apache-2.0
- Created
- May 27, 2025
- Updated
- May 27, 2025