Skip to content

sarimahsan101

Qwen2.5-0.5B-DPO-detox

sarimahsan101/Qwen2.5-0.5B-DPO-detox

Qwen2.5-0.5B-DPO-detox is a machine learning model from sarimahsan101. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

A DPO (Direct Preference Optimization) fine-tune of Qwen/Qwen2.5-0.5B-Instruct, trained to reduce toxic completions. This is the DPO counterpart to a prior PPO-based detox project (sarimahsan101/qwen2.5-0.5b-detox-ppo…

Downloads · 30 days

12

19% of all-time downloads

All-time downloads

62

Public

Parameters

494M

1000 MB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors988 MB · 99%

At a glance

License
apache-2.0
Model type
qwen2
Access
Public
Created
Jul 25, 2026
Updated
Jul 25, 2026
SHA
5d0f7d9d

Base models

Type
qwen2
License
apache-2.0
Languages
en
Created
Jul 25, 2026
Updated
Jul 25, 2026