Downloads · 30 days
0
Qwen3-8B-CommonSense170K-LoRA
tianzl66/Qwen3-8B-CommonSense170K-LoRA
Qwen3-8B-CommonSense170K-LoRA is a machine learning model from tianzl66. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
semodel: Qwen/Qwen3-8B libraryname: peft tags: - qwen3 - lora - peft - commonsense-reasoning - spectral-surgery ---
Access
Public
Updated Aug 29, 2026
Repo size
175 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors175 MB · 100%
At a glance
- Access
- Public
- Created
- Aug 29, 2026
- Updated
- Aug 29, 2026
- SHA
- f8fde012
Model card
From the Hugging Face model README
se_model: Qwen/Qwen3-8B library_name: peft tags:
- qwen3
- lora
- peft
- commonsense-reasoning
- spectral-surgery
Qwen3-8B + Commonsense170K — LoRA
LoRA adapter obtained by supervised fine-tuning Qwen3-8B on Commonsense170K.
This checkpoint serves as the source adapter for the corresponding Spectral Surgery experiment.
Training
- Dataset: Commonsense170K
- Samples: 170,420
- Epochs: 2
- Sequence length: 2048
- Global batch size: 32
- Learning rate: 2e-4
- Scheduler: cosine
- Warmup ratio: 0.10
- LoRA rank: 16
- LoRA alpha: 32
- LoRA dropout: 0.05
- Target modules: all linear layers
- Precision: bf16
- Seed: 42
- Chat mode: Qwen3 non-thinking
Evaluation
Eight-task commonsense suite:
- BoolQ
- PIQA
- SocialIQA
- HellaSwag
- WinoGrande
- ARC-Easy
- ARC-Challenge
- OpenBookQA
| Metric | Result |
|---|---|
| Macro Accuracy | 90.7879% |
| Micro Accuracy | 91.8373% |
| Correct | 20,589 / 22,419 |
Evaluation uses the tokenizer chat template in non-thinking mode, greedy decoding, and a maximum of 8 generated tokens.
Spectral Surgery
This adapter is the source checkpoint for the corresponding Spectral Surgery model.
- Created
- Aug 29, 2026
- Updated
- Aug 29, 2026