Downloads · 30 days
12
20% of all-time downloads
WhyTheMoon/Mistral-7B-Instruct-v0.3_RR_Keyword-Bio
Mistral-7B-Instruct-v0.3_RR_Keyword-Bio is a text generation model from WhyTheMoon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Best Mistral-7B-Instruct-v0.3 checkpoint unlearned using RR with the Keyword-Bio forget set. For more details, please check our paper.
Downloads · 30 days
12
20% of all-time downloads
All-time downloads
61
Public
Parameters
9.6B
19.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors19.3 GB · 100%
From the Hugging Face model README
Best Mistral-7B-Instruct-v0.3 checkpoint unlearned using RR with the Keyword-Bio forget set. For more details, please check our paper.
| WMDP-Bio | tinyMMLU | GSM8k | TriviaQA | |
|---|---|---|---|---|
| Mistral-7B-Instruct-v0.3 | 67.48 | 64.20 | 50.19 | 56.81 |
| Mistral-7B-Instruct-v0.3_RR_Keyword-Bio | 49.18 | 63.95 | 47.38 | 57.48 |
If you find this useful in your research, please consider citing our paper:
@misc{zhu2025llmunlearningexpertcurated,
title={LLM Unlearning Without an Expert Curated Dataset},
author={Xiaoyuan Zhu and Muru Zhang and Ollie Liu and Robin Jia and Willie Neiswanger},
year={2025},
eprint={2508.06595},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2508.06595},
}