Downloads · 30 days
9
14% of all-time downloads
mlabonne_NeuralDaredevil-8B-abliterated-2_2bpw_exl2
Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-2_2bpw_exl2
mlabonne_NeuralDaredevil-8B-abliterated-2_2bpw_exl2 is a text generation model from Zoyd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.1
All-time downloads
66
Public
Repo size
3.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- May 28, 2024
- Updated
- May 28, 2024
- SHA
- eb92020d
Try a prompt
Datasets
Model card
From the Hugging Face model README
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.1
Other EXL2 quants:
| Quant | Model Size | lm_head |
|---|---|---|
| <center>2.2</center> | <center>3250 MB</center> | <center>6</center> |
| <center>2.5</center> | <center>3479 MB</center> | <center>6</center> |
| <center>3.0</center> | <center>3895 MB</center> | <center>6</center> |
| <center>3.5</center> | <center>4310 MB</center> | <center>6</center> |
| <center>3.75</center> | <center>4519 MB</center> | <center>6</center> |
| <center>4.0</center> | <center>4727 MB</center> | <center>6</center> |
| <center>4.25</center> | <center>4931 MB</center> | <center>6</center> |
| <center>5.0</center> | <center>5559 MB</center> | <center>6</center> |
| <center>6.0</center> | <center>6495 MB</center> | <center>8</center> |
| <center>6.5</center> | <center>6903 MB</center> | <center>8</center> |
| <center>8.0</center> | <center>8157 MB</center> | <center>8</center> |
NeuralDaredevil-8B-abliterated
This is a DPO fine-tune of mlabonne/Daredevil-8-abliterated trained on one epoch of mlabonne/orpo-dpo-mix-40k.
🏆 Evaluation
Open LLM Leaderboard
TBD.
Nous
Evaluation performed using LLM AutoEval. See the entire leaderboard here.
| Model | Average | AGIEval | GPT4All | TruthfulQA | Bigbench |
|---|---|---|---|---|---|
| mlabonne/NeuralDaredevil-8B-abliterated 📄 | 55.87 | 43.73 | 73.6 | 59.36 | 46.8 |
| mlabonne/Daredevil-8B 📄 | 55.87 | 44.13 | 73.52 | 59.05 | 46.77 |
| mlabonne/Daredevil-8B-abliterated 📄 | 55.06 | 43.29 | 73.33 | 57.47 | 46.17 |
| NousResearch/Hermes-2-Theta-Llama-3-8B 📄 | 54.28 | 43.9 | 72.62 | 56.36 | 44.23 |
| openchat/openchat-3.6-8b-20240522 📄 | 53.49 | 44.03 | 73.67 | 49.78 | 46.48 |
| meta-llama/Meta-Llama-3-8B-Instruct 📄 | 51.34 | 41.22 | 69.86 | 51.65 | 42.64 |
| meta-llama/Meta-Llama-3-8B 📄 | 45.42 | 31.1 | 69.95 | 43.91 | 36.7 |
🌳 Model family tree
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- May 28, 2024
- Updated
- May 28, 2024