Downloads · 30 days
4
6% of all-time downloads
yuk1chan/qwen3-4b-sft-5k-mix-merged
qwen3-4b-sft-5k-mix-merged is a text generation model from yuk1chan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository provides a merged FP16 model fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (Unsloth).
Downloads · 30 days
4
6% of all-time downloads
All-time downloads
69
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
This repository provides a merged FP16 model fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (Unsloth).
This model is trained to improve structured output accuracy (JSON / YAML / XML / TOML / CSV).
Loss is applied only to the final assistant output, while intermediate reasoning (Chain-of-Thought) is masked.
from transformers import AutoModelForCausalLM, AutoTokenizer import torch
model_id = "yuk1chan/qwen3-4b-sft-5k-mix-merged"
tokenizer = AutoTokenizer.from_pretrained(model_id) model = AutoModelForCausalLM.from_pretrained( model_id, torch_dtype=torch.float16, device_map="auto", )
Training data: daichira/structured-5k-mix-sft
Dataset License: MIT License. This dataset is used and distributed under the terms of the MIT License. Compliance: Users must comply with the MIT license (including copyright notice) and the base model's original terms of use.