Downloads · 30 days
12
2% of all-time downloads
TheMelonGod/miscii-14b-0218-exl2
miscii-14b-0218-exl2 is a text generation model from TheMelonGod. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Orignal Model by: sthenno-com Orignal Model: miscii-14b-0218
Downloads · 30 days
12
2% of all-time downloads
All-time downloads
685
Public
Repo size
335 GB
Likes
1
Public
Click a slice to open those files.
.json2.8 MB · 100%
From the Hugging Face model README
Orignal Model by: sthenno-com
Orignal Model: miscii-14b-0218
For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
ExLlamaV2 Quantizations:
8.0bpw: 8hb | 6hb
7.5bpw: 8hb | 6hb
7.0bpw: 8hb | 6hb
6.5bpw: 8hb | 6hb
6.0bpw: 8hb | 6hb
5.5bpw: 8hb | 6hb
5.0bpw: 8hb | 6hb
4.5bpw: 8hb | 6hb
4.25bpw: 8hb | 6hb
4.0bpw: 8hb | 6hb
3.75bpw: 8hb | 6hb
3.5bpw: 8hb | 6hb
3.0bpw: 8hb | 6hb
2.75bpw: 8hb | 6hb
2.5bpw: 8hb | 6hb
2.25bpw: 8hb | 6hb
2.0bpw: 8hb | 6hb
Measurement File (Default/built-in calibration dataset was used)
If you need a specific model quantized or particular bits per weight, please let me know. I’m happy to help.
Your feedback and suggestions are always welcome! They help me improve and make quantizations better for everyone.
Special thanks to turboderp for developing the tools that made these quantizations possible. Your contributions are greatly appreciated!