Downloads · 30 days
4
8% of all-time downloads
WhyTheMoon/Llama-3-8B-Instruct_RMU_Textbook-HP-Simplest
Llama-3-8B-Instruct_RMU_Textbook-HP-Simplest is a text generation model from WhyTheMoon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Best Meta-Llama-3-8B-Instruct checkpoint unlearned using RMU with the Textbook-HP-Simplest forget set. For more details, please check our paper.
Downloads · 30 days
4
8% of all-time downloads
All-time downloads
50
Public
Repo size
16.1 GB
Likes
0
Public
Click a slice to open those files.
.bin16.1 GB · 100%
From the Hugging Face model README
Best Meta-Llama-3-8B-Instruct checkpoint unlearned using RMU with the Textbook-HP-Simplest forget set. For more details, please check our paper.
| HP MCQ | tinyMMLU | GSM8k | TriviaQA | |
|---|---|---|---|---|
| Llama-3-8B-Instruct | 75.63 | 59.21 | 75.28 | 51.09 |
| Llama-3-8B-Instruct_RMU_Textbook-HP-Simplest | 30.83 | 55.10 | 74.00 | 49.87 |
If you find this useful in your research, please consider citing our paper:
@misc{zhu2025llmunlearningexpertcurated,
title={LLM Unlearning Without an Expert Curated Dataset},
author={Xiaoyuan Zhu and Muru Zhang and Ollie Liu and Robin Jia and Willie Neiswanger},
year={2025},
eprint={2508.06595},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2508.06595},
}