Skip to content

yavuz-ai

qwen3-4b-dpo-ultrafeedback-lora

yavuz-ai/qwen3-4b-dpo-ultrafeedback-lora

qwen3-4b-dpo-ultrafeedback-lora is a text generation model from yavuz-ai. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.

LoRA DPO adapter for Qwen3-4B-Instruct-2507, trained on UltraFeedback. one leg of crossfamily-dpo: the same recipe run across two model families (Qwen + Mistral).

Downloads · 30 days

12

16% of all-time downloads

All-time downloads

76

Public

Repo size

144 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors132 MB · 92%

At a glance

Task
Text Generation
Library
peft
License
apache-2.0
Access
Public
Created
Jun 18, 2026
Updated
Jun 18, 2026
SHA
152a0aeb

Try a prompt

Base models

Task
Text Generation
Library
peft
License
apache-2.0
Created
Jun 18, 2026
Updated
Jun 18, 2026