Downloads · 30 days
3
9% of all-time downloads
Zoyd/nyunai_nyun-llama3-62B-2_5bpw_exl2
nyunai_nyun-llama3-62B-2_5bpw_exl2 is a text generation model from Zoyd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
Exllamav2 quant (exl2 / 2.5 bpw) made with ExLlamaV2 v0.1.3
Downloads · 30 days
3
9% of all-time downloads
All-time downloads
34
Public
Repo size
21.6 GB
Likes
0
Public
Click a slice to open those files.
.safetensors21.6 GB · 100%
From the Hugging Face model README
Exllamav2 quant (exl2 / 2.5 bpw) made with ExLlamaV2 v0.1.3
Other EXL2 quants:
| Quant | Model Size | lm_head |
|---|---|---|
| <center>2.2</center> | <center>18625 MB</center> | <center>6</center> |
| <center>2.5</center> | <center>20645 MB</center> | <center>6</center> |
| <center>3.0</center> | <center>24211 MB</center> | <center>6</center> |
| <center>3.5</center> | <center>27784 MB</center> | <center>6</center> |
| <center>3.75</center> | <center>29572 MB</center> | <center>6</center> |
| <center>4.0</center> | <center>31359 MB</center> | <center>6</center> |
| <center>4.25</center> | <center>33139 MB</center> | <center>6</center> |
| <center>5.0</center> | <center>38500 MB</center> | <center>6</center> |
| <center>6.0</center> | <center>45805 MB</center> | <center>8</center> |
| <center>6.5</center> | <center>49410 MB</center> | <center>8</center> |
| <center>8.0</center> | <center>54655 MB</center> | <center>8</center> |