Downloads · 30 days
8
3% of all-time downloads
lora_structeval_t_qwen3_4b_v5_parammatch
magoemu/lora_structeval_t_qwen3_4b_v5_parammatch
lora_structeval_t_qwen3_4b_v5_parammatch is a text generation model from magoemu. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
All-time downloads
232
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.1 GB · 96%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Feb 7, 2026
- Updated
- Feb 7, 2026
- SHA
- 0848413f
Try a prompt
Base models
Model card
From the Hugging Face model README
lora_structeval_t_qwen3_4b_v5_parammatch
This repository provides a LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (4-bit, Unsloth).
This repository contains LoRA adapter weights only. The base model must be loaded separately.
Training Configuration
- Base model: Qwen/Qwen3-4B-Instruct-2507
- Max sequence length: 1024
- Epochs: 2
- Learning rate: 2e-06
- LoRA: r=128, alpha=128, dropout=0.0
Notes
- Loss is applied to assistant response tokens.
- Optional CoT masking is enabled/disabled by CONFIG.
Sources & Terms
Training data: u-10bei/structured_data_with_cot_dataset_512_v4 Please follow the dataset and base model licenses/terms.
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Feb 7, 2026
- Updated
- Feb 7, 2026