Downloads · 30 days
3
2% of all-time downloads
TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2
Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2 is a text generation model from TheMelonGod. Use it when you need the model to write or continue text. The card lists the license as llama3.1.
ExLlamaV2 quantizations of: Joseph717171 - Llama-3.1-SuperNova-8B-LiteTIESwithBase
Downloads · 30 days
3
2% of all-time downloads
All-time downloads
150
Public
Repo size
93.1 GB
Likes
0
Public
Click a slice to open those files.
.md2.8 KB · 64%
From the Hugging Face model README
ExLlamaV2 quantizations of: Joseph717171 - Llama-3.1-SuperNova-8B-Lite_TIES_with_Base
Quantizations (6hb)
8.0bpw
7.5bpw
7.0bpw
6.5bpw
6.0bpw
5.5bpw
5.0bpw
4.5bpw
4.25bpw
4.0bpw
3.75bpw
3.5bpw
3.0bpw
2.75bpw
2.5bpw
2.25bpw
2.0bpw
If you need a specific model quantization or a particular bits per weight, please let me know. I’m happy to help quantize lesser known models.
If you have any suggestions for improvements or feedback, feel free to reach out. Your input is greatly appreciated and helps me make quantizations better for everyone.
Special thanks to turboderp for developing the tools that made these quantizations possible. Your contributions are greatly appreciated!