Downloads · 30 days
11
13% of all-time downloads
WhyTheMoon/Mistral-7B-Instruct-v0.3_RMU_Filter-Bio
Mistral-7B-Instruct-v0.3_RMU_Filter-Bio is a text generation model from WhyTheMoon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Best Mistral-7B-Instruct-v0.3 checkpoint unlearned using RMU with the Filter-Bio forget set. For more details, please check our paper.
Downloads · 30 days
11
13% of all-time downloads
All-time downloads
82
Public
Repo size
14.5 GB
Likes
0
Public
Click a slice to open those files.
.bin14.5 GB · 100%
From the Hugging Face model README
Best Mistral-7B-Instruct-v0.3 checkpoint unlearned using RMU with the Filter-Bio forget set. For more details, please check our paper.
| WMDP-Bio | tinyMMLU | GSM8k | TriviaQA | |
|---|---|---|---|---|
| Mistral-7B-Instruct-v0.3 | 67.48 | 64.20 | 50.19 | 56.81 |
| Mistral-7B-Instruct-v0.3_RMU_Filter-Bio | 26.39 | 52.54 | 44.04 | 56.51 |
If you find this useful in your research, please consider citing our paper:
@misc{zhu2025llmunlearningexpertcurated,
title={LLM Unlearning Without an Expert Curated Dataset},
author={Xiaoyuan Zhu and Muru Zhang and Ollie Liu and Robin Jia and Willie Neiswanger},
year={2025},
eprint={2508.06595},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2508.06595},
}