Skip to content

yavuz-ai

qwen2.5-3b-dpo-finqa

yavuz-ai/qwen2.5-3b-dpo-finqa

qwen2.5-3b-dpo-finqa is a text generation model from yavuz-ai. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.

A LoRA policy from DPO on FinQA, where the preference pairs come from the same verifiable reward as the GRPO arm: sample completions from the base, label each correct/incorrect by whether the final number is right, pa…

Downloads · 30 days

8

11% of all-time downloads

All-time downloads

76

Public

Repo size

131 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors120 MB · 91%

At a glance

Task
Text Generation
Library
peft
License
apache-2.0
Access
Public
Created
Jun 19, 2026
Updated
Jun 20, 2026
SHA
054c478f

Try a prompt

Base models

Task
Text Generation
Library
peft
License
apache-2.0
Created
Jun 19, 2026
Updated
Jun 20, 2026