Skip to content

ryo-llm

dpo-qwen-cot-merged-202602081200

ryo-llm/dpo-qwen-cot-merged-202602081200

dpo-qwen-cot-merged-202602081200 is a text generation model from ryo-llm. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using Direct Preference Optimization (DPO) via the Unsloth library.

Downloads · 30 days

7

8% of all-time downloads

All-time downloads

84

Public

Parameters

4.1B

4.1 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors4.1 GB · 100%

Parameter types

How the weights are stored.

U83.1B · 76%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3
License
apache-2.0
Languages
en
Created
Feb 8, 2026
Updated
Feb 8, 2026