Skip to content

Mutyuu

Qwen2.5-0.5B-Instruct-dpo_lr1e-7-1ep

Mutyuu/Qwen2.5-0.5B-Instruct-dpo_lr1e-7-1ep

Qwen2.5-0.5B-Instruct-dpo_lr1e-7-1ep is a text generation model from Mutyuu. Use it when you need the model to write or continue text. It is set up for transformers.

This model is a fine-tuned version of Qwen/Qwen2.5-0.5B-Instruct on the trl-lib/ultrafeedbackbinarized dataset. It has been trained using TRL.

Downloads · 30 days

8

6% of all-time downloads

All-time downloads

129

Public

Parameters

630M

20.2 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors1.3 GB · 99%

At a glance

Task
Text Generation
Library
transformers
Model type
qwen2
Access
Public
Created
Nov 29, 2025
Updated
Nov 29, 2025
SHA
56aa661a

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen2
Created
Nov 29, 2025
Updated
Nov 29, 2025