Skip to content

nakano0takashi

qwen3-4b-dpo-qwen-cot-merged-0206-S2

nakano0takashi/qwen3-4b-dpo-qwen-cot-merged-0206-S2

qwen3-4b-dpo-qwen-cot-merged-0206-S2 is a machine learning model from nakano0takashi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507. It has been trained using TRL.

Downloads · 30 days

0

Access

Public

Updated Feb 6, 2026

Repo size

144 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors132 MB · 92%

At a glance

Library
transformers
Access
Public
Created
Feb 6, 2026
Updated
Feb 6, 2026
SHA
7666958e

Base models

Library
transformers
Created
Feb 6, 2026
Updated
Feb 6, 2026