Downloads · 30 days
0
annasus10/qwen2.5-0.5b-truthy-dpo
qwen2.5-0.5b-truthy-dpo is a machine learning model from annasus10. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is a DPO fine-tuned version of Qwen/Qwen2.5-0.5B-Instruct trained on the jondurbin/truthy-dpo-v0.1 dataset for NLP-Assignment5 on human preference optimization and LLM-as-a-Judge evaluation.
Downloads · 30 days
0
Access
Public
Updated Mar 11, 2026
Repo size
15.8 MB
Likes
0
Public
Click a slice to open those files.
.json11.4 MB · 72%
From the Hugging Face model README
This model is a DPO fine-tuned version of Qwen/Qwen2.5-0.5B-Instruct trained on the jondurbin/truthy-dpo-v0.1 dataset for NLP-Assignment5 on human preference optimization and LLM-as-a-Judge evaluation.
This model was trained for educational purposes as part of an NLP assignment on preference optimization and factuality alignment.
This model may still hallucinate or produce incorrect outputs. It has only been trained on a relatively small preference dataset and should not be used in high-stakes settings.