Downloads · 30 days
15
9% of all-time downloads
llama-3.1-8b-instruct-snmf-wmdp-cyber
shirasko/llama-3.1-8b-instruct-snmf-wmdp-cyber
llama-3.1-8b-instruct-snmf-wmdp-cyber is a text generation model from shirasko. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
171
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Aug 2, 2026
- Updated
- Aug 10, 2026
- SHA
- cd95ce66
Try a prompt
Base models
Model card
From the Hugging Face model README
Unlearned Checkpoint
| Field | Value |
|---|---|
| Unlearning method | SNMF |
| Base model | meta-llama/Llama-3.1-8B-Instruct |
| Target concept | wmdp-cyber |
| Checkpoint type | Full Model Weights |
| Rank / seed | 200 / 42 |
| Train eval protocol | mc |
Unlearning Configuration
Selected hyperparameters (from unlearned_checkpoints.json):
| Parameter | Value |
|---|---|
coverage_thresh | 0.95 |
delta_embed | 0 |
delta_in | 1 |
delta_out | 10 |
feature_source | all |
k_features_embed | 0 |
k_features_mlp_in | 200 |
k_features_mlp_out | 43 |
layer_hi_in | 31 |
layer_hi_out | 31 |
layer_lo_in | 0 |
layer_lo_out | 16 |
n_tokens_edited | 0 |
ratio_thresh | 2 |
w_mode | both |
Primary Unlearning Metrics (held-out test, MC protocol)
Headline scores used for checkpoint selection:
| Metric | Train (after unlearning) | Test (after unlearning) |
|---|---|---|
| Efficacy | 0.353 | 0.522 |
| Specificity | 1 | 0.949 |
| Harmonic mean | 0.522 | 0.673 |
| Relearning QA (MC) | — | 0.44 |
Full Evaluation (baseline → unlearned)
From evaluation/score_comparison.csv:
| Metric | Baseline (train) | After unlearn (train) | Baseline (test) | After unlearn (test) |
|---|---|---|---|---|
| QA accuracy | 0.42 | 0.36 | 0.48 | 0.36 |
| QA fraction | 1 | 0.647 | 1 | 0.478 |
| SimDom accuracy | 0.58 | 0.66 | 0.5 | 0.48 |
| SimDom fraction | 1 | 1 | 1 | 0.92 |
| MMLU accuracy | 0.62 | 0.64 | 0.65 | 0.642 |
| MMLU fraction | 1 | 1 | 1 | 0.98 |
Files in This Repository
| File | Description |
|---|---|
unlearned_checkpoints.json | Checkpoint metadata & hyperparameters |
evaluation/evaluation_summary.json | Full evaluation payload (train/test/relearning) |
evaluation/score_comparison.csv | Baseline vs. unlearned comparison table |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- en
- Created
- Aug 2, 2026
- Updated
- Aug 10, 2026