Downloads · 30 days
10
2% of all-time downloads
qwen3.5-2b-rmu-cannabis
shirasko/qwen3.5-2b-rmu-cannabis
qwen3.5-2b-rmu-cannabis is a text generation model from shirasko. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
428
Public
Parameters
1.9B
3.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.8 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen3_5_text
- Access
- Public
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026
- SHA
- 8b96f2f1
Try a prompt
Base models
Model card
From the Hugging Face model README
Unlearned Checkpoint
| Field | Value |
|---|---|
| Unlearning method | RMU |
| Base model | Qwen/Qwen3.5-2B |
| Target concept | Cannabis |
| Checkpoint type | Full Model Weights |
| Rank / seed | 100 / 42 |
| Train eval protocol | mc |
Unlearning Configuration
Selected hyperparameters (from unlearned_checkpoints.json):
| Parameter | Value |
|---|---|
alpha | 50 |
delta_embed | 0 |
k_features_embed | 0 |
layer_id | 7 |
layer_ids | 5,6,7 |
lr | 0.0001 |
n_tokens_edited | 0 |
param_ids | 11 |
setting_name | S1_lid7_L567 |
steering | 300 |
Primary Unlearning Metrics (held-out test, MC protocol)
Headline scores used for checkpoint selection:
| Metric | Train (after unlearning) | Test (after unlearning) |
|---|---|---|
| Efficacy | 0.571 | 0.603 |
| Specificity | 0.584 | 0.571 |
| Harmonic mean | 0.578 | 0.586 |
| Relearning QA (MC) | — | 0.64 |
Full Evaluation (baseline → unlearned)
From evaluation/score_comparison.csv:
| Metric | Baseline (train) | After unlearn (train) | Baseline (test) | After unlearn (test) |
|---|---|---|---|---|
| QA accuracy | 0.74 | 0.46 | 0.88 | 0.5 |
| QA fraction | 1 | 0.429 | 1 | 0.397 |
| SimDom accuracy | 0.84 | 0.52 | 0.64 | 0.42 |
| SimDom fraction | 1 | 0.458 | 1 | 0.436 |
| MMLU accuracy | 0.56 | 0.5 | 0.588 | 0.529 |
| MMLU fraction | 1 | 0.806 | 1 | 0.825 |
Files in This Repository
| File | Description |
|---|---|
unlearned_checkpoints.json | Checkpoint metadata & hyperparameters |
evaluation/evaluation_summary.json | Full evaluation payload (train/test/relearning) |
evaluation/score_comparison.csv | Baseline vs. unlearned comparison table |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_5_text
- Languages
- en
- Created
- Sep 3, 2026
- Updated
- Sep 3, 2026