Skip to content

steven0226

qwen2.5-0.5b-dpo-ultrafeedback

steven0226/qwen2.5-0.5b-dpo-ultrafeedback

qwen2.5-0.5b-dpo-ultrafeedback is a text generation model from steven0226. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Qwen/Qwen2.5-0.5B-Instruct 以 DPO(Direct Preference Optimization) 在 HuggingFaceH4/ultrafeedbackbinarized(trainprefs split)的 6000 組偏好資料對上做偏好對齊。

Downloads · 30 days

51

7% of all-time downloads

All-time downloads

733

Public

Parameters

494M

1000 MB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors988 MB · 99%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
qwen2
Access
Public
Created
Jul 10, 2026
Updated
Jul 10, 2026
SHA
fd1724ec

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen2
License
apache-2.0
Created
Jul 10, 2026
Updated
Jul 10, 2026