Downloads · 30 days
11
3% of all-time downloads
Valeciela/Impish_Nemo_12B-Q6_K_XL-GGUF
Impish_Nemo_12B-Q6_K_XL-GGUF is a machine learning model from Valeciela. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
11
3% of all-time downloads
All-time downloads
339
Public
Repo size
35.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf35.6 GB · 100%
From the Hugging Face model README
Static quantization of Impish Nemo 12B
| File | Notes |
|---|---|
| <p align="center">Impish_Nemo_12B.Q6_K_XL.gguf | Q6_K with select tensors quantized to Q8_0<br>7.23 bpw<br>~10% increase in size relative to Q6_K<br>Quantized from BF16<br>Very close in fidelity to full precision |
| <p align="center">Impish_Nemo_12B.BF16.gguf | Native precision GGUF<br>BF16 |