Downloads · 30 days
0
Qwen3-8B-CommonSense170K-Spectral-Surgery
tianzl66/Qwen3-8B-CommonSense170K-Spectral-Surgery
Qwen3-8B-CommonSense170K-Spectral-Surgery is a machine learning model from tianzl66. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
semodel: Qwen/Qwen3-8B libraryname: peft tags: - qwen3 - lora - peft - commonsense-reasoning - spectral-surgery ---
Access
Public
Updated Aug 29, 2026
Repo size
175 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors175 MB · 100%
At a glance
- Access
- Public
- Created
- Aug 29, 2026
- Updated
- Aug 29, 2026
- SHA
- a2b008b0
Model card
From the Hugging Face model README
se_model: Qwen/Qwen3-8B library_name: peft tags:
- qwen3
- lora
- peft
- commonsense-reasoning
- spectral-surgery
Qwen3-8B + Commonsense170K — Spectral Surgery
Post-hoc Spectral Surgery applied to a Qwen3-8B LoRA adapter fine-tuned on Commonsense170K.
No additional gradient-based training is performed during Spectral Surgery.
Source LoRA
- Dataset: Commonsense170K
- Training epochs: 2
- LoRA rank: 16
- LoRA alpha: 32
- Source checkpoint: Epoch 2
Spectral Surgery
- Method: Hybrid Newton-Schulz (HNS)
- Target modules:
o_proj,down_proj - LoRA rank: 16
- Fast HNS steps: 8
- Stable HNS steps: 2
- Configuration: HNS 8+2
See spectral_edit_meta.json for the exact edit metadata.
Evaluation
| Task | LoRA | + Spectral Surgery |
|---|---|---|
| BoolQ | 88.0734 | 88.2875 |
| PIQA | 90.2067 | 90.4788 |
| SocialIQA | 82.2416 | 82.2927 |
| HellaSwag | 94.2243 | 94.1844 |
| WinoGrande | 89.4238 | 89.5028 |
| ARC-Easy | 97.1801 | 97.3906 |
| ARC-Challenge | 91.5529 | 90.7850 |
| OpenBookQA | 93.4000 | 93.4000 |
| Macro | 90.7879 | 90.7902 |
| Micro | 91.8373 | 91.8640 |
Correct predictions:
- Source LoRA: 20,589 / 22,419
- Spectral Surgery: 20,595 / 22,419
On this eight-task commonsense suite, Spectral Surgery preserves the aggregate performance of the source LoRA adapter.
The small numerical difference should not be interpreted as a meaningful improvement.
Evaluation Setup
- Qwen3 tokenizer chat template
- Non-thinking mode
- Greedy decoding
- max_new_tokens: 8
- vLLM backend
- max model length: 2048
- seed: 42
- Created
- Aug 29, 2026
- Updated
- Aug 29, 2026