Skip to content

annasus10

qwen2.5-0.5b-truthy-dpo

annasus10/qwen2.5-0.5b-truthy-dpo

qwen2.5-0.5b-truthy-dpo is a machine learning model from annasus10. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This model is a DPO fine-tuned version of Qwen/Qwen2.5-0.5B-Instruct trained on the jondurbin/truthy-dpo-v0.1 dataset for NLP-Assignment5 on human preference optimization and LLM-as-a-Judge evaluation.

Downloads · 30 days

0

Access

Public

Updated Mar 11, 2026

Repo size

15.8 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.json11.4 MB · 72%

At a glance

Access
Public
Created
Mar 11, 2026
Updated
Mar 11, 2026
SHA
1a114966
Created
Mar 11, 2026
Updated
Mar 11, 2026