Downloads · 30 days
8
25% of all-time downloads
lora_structeval_t_qwen3_4b_v6_try_a
magoemu/lora_structeval_t_qwen3_4b_v6_try_a
lora_structeval_t_qwen3_4b_v6_try_a is a text generation model from magoemu. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
All-time downloads
32
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.1 GB · 99%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Feb 7, 2026
- Updated
- Feb 8, 2026
- SHA
- e317cbee
Try a prompt
Base models
Model card
From the Hugging Face model README
lora_structeval_t_qwen3_4b_v6_try_a
This repository provides a LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (4-bit, Unsloth).
This repository contains LoRA adapter weights only. The base model must be loaded separately.
Training Configuration
- Base model: Qwen/Qwen3-4B-Instruct-2507
- Max sequence length: 1024
- Epochs: 2
- Learning rate: 2e-06
- LoRA: r=128, alpha=128, dropout=0.0
Notes
- Loss is applied to assistant response tokens.
Dataset Note
- Base dataset:
u-10bei/structured_data_with_cot_dataset_512_v2 - Training file used locally:
../dataset/structured_data_with_cot_dataset_512_v2_filtered.parquet - Filtering: removed 64 rows where
format=xmlandschema=api_specificationhad invalid XML inOutput:block. - Final train source rows: 3869 (from 3933)
Sources & Terms
Training data: u-10bei/structured_data_with_cot_dataset_512_v2 Please follow the dataset and base model licenses/terms.
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Feb 7, 2026
- Updated
- Feb 8, 2026