Downloads · 30 days
4
11% of all-time downloads
Llama-3.1-8B-Instruct-Magicoder-50K-SpectralSurgery-HNS8p2
tianzl66/Llama-3.1-8B-Instruct-Magicoder-50K-SpectralSurgery-HNS8p2
Llama-3.1-8B-Instruct-Magicoder-50K-SpectralSurgery-HNS8p2 is a machine learning model from tianzl66. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This repository contains the Spectral Surgery adapter obtained from Llama-3.1-8B-Instruct fine-tuned on 50K Magicoder examples.
All-time downloads
37
Public
Repo size
521 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt336 MB · 64%
At a glance
- Library
- peft
- Access
- Public
- Created
- Aug 27, 2026
- Updated
- Aug 27, 2026
- SHA
- 8dc385b0
Base models
Model card
From the Hugging Face model README
Llama-3.1-8B-Instruct + Magicoder + Spectral Surgery
This repository contains the Spectral Surgery adapter obtained from Llama-3.1-8B-Instruct fine-tuned on 50K Magicoder examples.
Base Model
meta-llama/Llama-3.1-8B-Instruct
Training
- Dataset: Magicoder
- Samples: 50K
- Sequence length: 4096
- Global batch size: 32
- Learning rate: 2e-5
- LoRA rank: 16
- LoRA alpha: 32
- Source checkpoint: Epoch 1
Spectral Surgery
- Target: all LoRA modules
- Output rank: 16
- Fast HNS steps: 8
- Stable HNS steps: 2
Evaluation
Greedy decoding with Pass@1.
| Model | HumanEval | MBPP |
|---|---|---|
| Base | 54.27% (89/164) | 65.37% (168/257) |
| LoRA E1 | 56.10% (92/164) | 60.70% (156/257) |
| HNS 4+1 | 58.54% (96/164) | 65.37% (168/257) |
| HNS 8+2 | 60.98% (100/164) | 64.98% (167/257) |
Relative to the base model, HNS 8+2 improves HumanEval by 6.71 percentage points while approximately preserving MBPP performance.
Relative to the vanilla LoRA checkpoint, HNS 8+2 improves HumanEval by 4.88 percentage points and MBPP by 4.28 percentage points.
- Library
- peft
- Created
- Aug 27, 2026
- Updated
- Aug 27, 2026