Downloads · 30 days
22
52% of all-time downloads
lora-sft-v5
astom-M/lora-sft-v5
lora-sft-v5 is a text generation model from astom-M. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (4-bit, Unsloth). LoRA adapter weights only - base model must be loaded separately.
All-time downloads
42
Public
Repo size
540 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors529 MB · 97%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Feb 28, 2026
- Updated
- Feb 28, 2026
- SHA
- 1dff66dc
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-4B Structured Output LoRA (v5)
LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (4-bit, Unsloth). LoRA adapter weights only - base model must be loaded separately.
Training Objective
Improve structured output accuracy (JSON / YAML / XML / TOML / CSV). Loss applied only to final assistant output (CoT masked).
Training Configuration
- Base model: Qwen/Qwen3-4B-Instruct-2507
- Method: QLoRA (4-bit) + rsLoRA
- Max sequence length: 1024
- Epochs: 2
- Learning rate: 2e-05
- LoRA: r=64, alpha=128
- Effective batch size: 16
Sources & Terms
Training data: u-10bei/structured_data_with_cot_dataset_512_v2 Dataset License: MIT License.
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Feb 28, 2026
- Updated
- Feb 28, 2026