Downloads · 30 days
5
8% of all-time downloads
dpo-qwen-cot-merged_v2
Momoka1010/dpo-qwen-cot-merged_v2
dpo-qwen-cot-merged_v2 is a machine learning model from Momoka1010. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using DPO.
All-time downloads
66
Public
Parameters
4B
8.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors9.1 GB · 97%
At a glance
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Feb 7, 2026
- Updated
- Feb 7, 2026
- SHA
- 82a4999d
Base models
Datasets
Model card
From the Hugging Face model README
qwen3-4b-dpo-qwen-cot-merged_v2
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 using DPO.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "Momoka1010/dpo-qwen-cot-merged_v2"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto")
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Feb 7, 2026
- Updated
- Feb 7, 2026