Skip to content

ryo-llm

dpo-qwen-cot-merged-202602081050

ryo-llm/dpo-qwen-cot-merged-202602081050

dpo-qwen-cot-merged-202602081050 is a text generation model from ryo-llm. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library.

Downloads · 30 days

0

Access

Public

Updated Feb 8, 2026

Repo size

—

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.md1.9 KB · 55%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Access
Public
Created
Feb 8, 2026
Updated
Feb 8, 2026
SHA
a09d6bf7

Try a prompt

Base models

Task
Text Generation
Library
transformers
License
apache-2.0
Languages
en
Created
Feb 8, 2026
Updated
Feb 8, 2026