Downloads · 30 days
8
15% of all-time downloads
mlabonne_Daredevil-8B-abliterated-2_2bpw_exl2
Zoyd/mlabonne_Daredevil-8B-abliterated-2_2bpw_exl2
mlabonne_Daredevil-8B-abliterated-2_2bpw_exl2 is a text generation model from Zoyd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.1
All-time downloads
53
Public
Repo size
3.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- May 28, 2024
- Updated
- May 28, 2024
- SHA
- 3b7725bb
Try a prompt
Model card
From the Hugging Face model README
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.1
Other EXL2 quants:
| Quant | Model Size | lm_head |
|---|---|---|
| <center>2.2</center> | <center>3250 MB</center> | <center>6</center> |
| <center>2.5</center> | <center>3479 MB</center> | <center>6</center> |
| <center>3.0</center> | <center>3895 MB</center> | <center>6</center> |
| <center>3.5</center> | <center>4310 MB</center> | <center>6</center> |
| <center>3.75</center> | <center>4519 MB</center> | <center>6</center> |
| <center>4.0</center> | <center>4727 MB</center> | <center>6</center> |
| <center>4.25</center> | <center>4935 MB</center> | <center>6</center> |
| <center>5.0</center> | <center>5559 MB</center> | <center>6</center> |
| <center>6.0</center> | <center>6497 MB</center> | <center>8</center> |
| <center>6.5</center> | <center>6913 MB</center> | <center>8</center> |
| <center>8.0</center> | <center>8150 MB</center> | <center>8</center> |
Daredevil-8B-abliterated
Abliterated version of mlabonne/Daredevil-8B using failspy's notebook.
It based on the technique described in the blog post "Refusal in LLMs is mediated by a single direction".
Thanks to Andy Arditi, Oscar Balcells Obeso, Aaquib111, Wes Gurnee, Neel Nanda, and failspy.
⚡ Quantization
🏆 Evaluation
Nous
| Model | Average | AGIEval | GPT4All | TruthfulQA | Bigbench |
|---|---|---|---|---|---|
| mlabonne/Daredevil-8B 📄 | 55.87 | 44.13 | 73.52 | 59.05 | 46.77 |
| mlabonne/Daredevil-8B-abliterated 📄 | 55.06 | 43.29 | 73.33 | 57.47 | 46.17 |
| mlabonne/Llama-3-8B-Instruct-abliterated-dpomix 📄 | 52.26 | 41.6 | 69.95 | 54.22 | 43.26 |
| meta-llama/Meta-Llama-3-8B-Instruct 📄 | 51.34 | 41.22 | 69.86 | 51.65 | 42.64 |
| failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 📄 | 51.21 | 40.23 | 69.5 | 52.44 | 42.69 |
| mlabonne/OrpoLlama-3-8B 📄 | 48.63 | 34.17 | 70.59 | 52.39 | 37.36 |
| meta-llama/Meta-Llama-3-8B 📄 | 45.42 | 31.1 | 69.95 | 43.91 | 36.7 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- May 28, 2024
- Updated
- May 28, 2024