Downloads · 30 days
5
12% of all-time downloads
deep-ignorance-unfiltered_unlearned_rmu
girishgupta/deep-ignorance-unfiltered_unlearned_rmu
deep-ignorance-unfiltered_unlearned_rmu is a machine learning model from girishgupta. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was created by fine-tuning EleutherAI/deep-ignorance-unfiltered using the Representation Misdirection Unlearning unlearning algorithm. The method is based on Li et al. 2024. The goal of unlearning is to rem…
All-time downloads
41
Public
Parameters
6.9B
13.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors13.7 GB · 100%
At a glance
- Model type
- gpt_neox
- Access
- Public
- Created
- Mar 11, 2026
- Updated
- Mar 11, 2026
- SHA
- 5c774d90
Base models
Model card
From the Hugging Face model README
deep-ignorance-unfiltered_unlearned_rmu
This model was created by fine-tuning EleutherAI/deep-ignorance-unfiltered using the Representation Misdirection Unlearning unlearning algorithm. The method is based on Li et al. 2024. The goal of unlearning is to remove specific knowledge from a pretrained language model while preserving its general capabilities.
Hyperparameters
| Parameter | Value |
|---|---|
| Base model | EleutherAI/deep-ignorance-unfiltered |
| Unlearning method | Representation Misdirection Unlearning |
| Learning rate | 2e-05 |
| Epochs | 1 |
| Batch size | 32 |
| Max sequence length | 2048 |
| Optimizer | adamw |
| Gradient clipping | 1.0 |
| Gradient accumulation steps | 1 |
| Seed | 42 |
| W&B / run name | rmu__ep1_lr2e-05_bs32_a1000.0_sc20.0_ly11-12-13_mle2048_mli1024 |
| Alpha (retain weight) | 1000.0 |
| Steering coefficient | 20.0 |
| Layer IDs | 11,12,13 |
- Type
- gpt_neox
- Created
- Mar 11, 2026
- Updated
- Mar 11, 2026