Skip to content

JeffCheng12138

qwen3-8b-dpo-ultrafeedback-zh

JeffCheng12138/qwen3-8b-dpo-ultrafeedback-zh

qwen3-8b-dpo-ultrafeedback-zh is a machine learning model from JeffCheng12138. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.

LoRA adapter (r=32, α=64) trained with DPO (β=0.1, sigmoid loss) on top of the SFT-merged base. Reference policy = SFT-merged base (trl's default with peftconfig + refmodel=None).

Downloads · 30 days

8

21% of all-time downloads

All-time downloads

38

Public

Repo size

361 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors349 MB · 97%

At a glance

Library
peft
License
apache-2.0
Access
Public
Created
May 2, 2026
Updated
May 2, 2026
SHA
30d4397d

Base models

Library
peft
License
apache-2.0
Languages
zh
Created
May 2, 2026
Updated
May 2, 2026