Downloads · 30 days
8
13% of all-time downloads
Zoyd/xxx777xxxASD_L3-SnowStorm-v1.15-4x8B-A-5_0bpw_exl2
xxx777xxxASD_L3-SnowStorm-v1.15-4x8B-A-5_0bpw_exl2 is a text generation model from Zoyd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
Exllamav2 quant (exl2 / 5.0 bpw) made with ExLlamaV2 v0.1.1
Downloads · 30 days
8
13% of all-time downloads
All-time downloads
63
Public
Repo size
16.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors16.4 GB · 100%
From the Hugging Face model README
Exllamav2 quant (exl2 / 5.0 bpw) made with ExLlamaV2 v0.1.1
Other EXL2 quants:
| Quant | Model Size | lm_head |
|---|---|---|
| <center>2.2</center> | <center>7777 MB</center> | <center>6</center> |
| <center>2.5</center> | <center>8520 MB</center> | <center>6</center> |
| <center>3.0</center> | <center>9941 MB</center> | <center>6</center> |
| <center>3.5</center> | <center>11366 MB</center> | <center>6</center> |
| <center>3.75</center> | <center>12066 MB</center> | <center>6</center> |
| <center>4.0</center> | <center>12789 MB</center> | <center>6</center> |
| <center>4.25</center> | <center>13504 MB</center> | <center>6</center> |
| <center>5.0</center> | <center>15640 MB</center> | <center>6</center> |
| <center>6.0</center> | <center>18586 MB</center> | <center>8</center> |
| <center>6.5</center> | <center>20007 MB</center> | <center>8</center> |
| <center>8.0</center> | <center>24101 MB</center> | <center>8</center> |
[!NOTE] GGUF
Experimental RP-oriented MoE, the idea was to get a model that would be equal to or better than Mixtral 8x7B and it's finetunes in RP/ERP tasks.
There's:
base_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1-OAS
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: Nitral-AI_Poppy_Porpoise-1.0-L3-8B
- source_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1-OAS
- source_model: openlynn_Llama-3-Soliloquy-8B-v2
- source_model: Sao10K_L3-8B-Stheno-v3.1

Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 67.68 |
| AI2 Reasoning Challenge (25-Shot) | 62.20 |
| HellaSwag (10-Shot) | 81.09 |
| MMLU (5-Shot) | 67.89 |
| TruthfulQA (0-shot) | 52.11 |
| Winogrande (5-shot) | 76.32 |
| GSM8k (5-shot) | 66.49 |