Downloads · 30 days
12
14% of all-time downloads
WhyTheMoon/Mistral-7B-Instruct-v0.3_RMU_Keyword-Cyber
Mistral-7B-Instruct-v0.3_RMU_Keyword-Cyber is a text generation model from WhyTheMoon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Best Mistral-7B-Instruct-v0.3 checkpoint unlearned using RMU with the Keyword-Cyber forget set. For more details, please check our paper.
Downloads · 30 days
12
14% of all-time downloads
All-time downloads
84
Public
Repo size
14.5 GB
Likes
0
Public
Click a slice to open those files.
.bin14.5 GB · 100%
From the Hugging Face model README
Best Mistral-7B-Instruct-v0.3 checkpoint unlearned using RMU with the Keyword-Cyber forget set. For more details, please check our paper.
| WMDP-Cyber | tinyMMLU | GSM8k | TriviaQA | |
|---|---|---|---|---|
| Mistral-7B-Instruct-v0.3 | 41.52 | 64.20 | 50.19 | 56.81 |
| Mistral-7B-Instruct-v0.3_RMU_Keyword-Cyber | 23.10 | 64.82 | 50.19 | 56.96 |
If you find this useful in your research, please consider citing our paper:
@misc{zhu2025llmunlearningexpertcurated,
title={LLM Unlearning Without an Expert Curated Dataset},
author={Xiaoyuan Zhu and Muru Zhang and Ollie Liu and Robin Jia and Willie Neiswanger},
year={2025},
eprint={2508.06595},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2508.06595},
}