Downloads · 30 days
10
24% of all-time downloads
Llama-3.1-8B-Instruct-InstructionFollowing-LoRA
tianzl66/Llama-3.1-8B-Instruct-InstructionFollowing-LoRA
Llama-3.1-8B-Instruct-InstructionFollowing-LoRA is a machine learning model from tianzl66. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This repository contains the vanilla LoRA adapter used as the instruction-following SFT baseline for the Spectral Surgery experiments.
All-time downloads
41
Public
Repo size
168 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 100%
At a glance
- Library
- peft
- Access
- Public
- Created
- Aug 27, 2026
- Updated
- Aug 27, 2026
- SHA
- eba9374a
Base models
Model card
From the Hugging Face model README
Llama-3.1-8B-Instruct + Instruction-Following LoRA
This repository contains the vanilla LoRA adapter used as the instruction-following SFT baseline for the Spectral Surgery experiments.
Base Model
meta-llama/Llama-3.1-8B-Instruct
Training
- Sequence length: 1024
- Global batch size: 128
- LoRA rank: 16
- Seed: 42
Evaluation
Evaluation on IFEval.
| Model | Prompt Strict | Prompt Loose | Instruction Strict | Instruction Loose |
|---|---|---|---|---|
| Base | 65.80% | 72.83% | 75.54% | 81.18% |
| LoRA SFT | 65.99% | 70.98% | 74.82% | 79.26% |
| Spectral Surgery HNS 8+2 | 69.50% | 73.94% | 77.94% | 82.13% |
The vanilla LoRA checkpoint is used as the source checkpoint for the Spectral Surgery HNS 8+2 adapter.
- Library
- peft
- Created
- Aug 27, 2026
- Updated
- Aug 27, 2026