Downloads · 30 days
6
5% of all-time downloads
dpo-qwen-cot-merged
Momoka1010/dpo-qwen-cot-merged
dpo-qwen-cot-merged is a machine learning model from Momoka1010. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using DPO.
All-time downloads
111
Public
Parameters
4B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Feb 6, 2026
- Updated
- Feb 7, 2026
- SHA
- 228f6557
Base models
Datasets
Model card
From the Hugging Face model README
qwen3-4b-dpo-qwen-cot-merged
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using DPO.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "Momoka1010/dpo-qwen-cot-merged"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto")
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Feb 6, 2026
- Updated
- Feb 7, 2026