Downloads · 30 days
14
5% of all-time downloads
cyumizou/qwen3-4b-structured-output-merged-stage-a
qwen3-4b-structured-output-merged-stage-a is a text generation model from cyumizou. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
qwen3-4b-structured-output-merged-stage-a
Downloads · 30 days
14
5% of all-time downloads
All-time downloads
284
Public
Parameters
4B
24.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
qwen3-4b-structured-output-merged-stage-a
This repository provides a merged (fully materialized) model derived from Qwen/Qwen3-4B-Instruct-2507. The weights were obtained by training a LoRA adapter and then merging the adapter into the base model weights (merge-and-unload).
✅ You can load this model directly with AutoModelForCausalLM.from_pretrained()
❌ This is NOT an adapter-only repository.
This model corresponds to StageA in a two-stage training procedure.
StageA goal: stabilize output mode for structured generation:
json / xml / ```yaml)This merged model is intended to be used as a stable starting point for StageB (TOML failure-pattern mitigation) without drifting back to chatty preambles.
Improve structured output reliability (JSON / YAML / XML / TOML / CSV), especially eliminating non-structured preambles that break parsers.
Note: In StageA, loss is applied to the full assistant output to suppress preambles (if you used full-loss). If you used output-only loss, replace this sentence accordingly.
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "your_id/your-repo" # this repo
tokenizer = AutoTokenizer.from_pretrained(model_id, use_fast=True)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16, # or float16 depending on your environment
device_map="auto",
)
This model is derived only from the organizer-approved base model (Qwen/Qwen3-4B-Instruct-2507) and uses no architecture changes.
The merge operation is used only to integrate post-training results (SFT/LoRA) under the same architecture.
Training data: u-10bei/structured_data_with_cot_dataset_512_v2
Dataset License: MIT License. This dataset is used and distributed under the terms of the MIT License. Compliance: Users must comply with the MIT license (including copyright notice) and the base model's original terms of use.