Downloads · 30 days
63
2% of all-time downloads
NexesQuants/Llama_3.2_3b_Kermes_v2.1-iMat-CQ-GGUF
Llama_3.2_3b_Kermes_v2.1-iMat-CQ-GGUF is a machine learning model from NexesQuants. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.2.
Downloads · 30 days
63
2% of all-time downloads
All-time downloads
2.7K
Public
Repo size
28.1 GB
Likes
1
Public
Click a slice to open those files.
.gguf28.1 GB · 100%
From the Hugging Face model README
GGUF static quantizations (Thanks!) :
https://huggingface.co/mradermacher/Llama_3.2_3b_Kermes_v2.1-GGUF
GGUF custom quantizations:
Perplexity at 512 ctx, wikitext english :
Best :
Recommended :
Best compromises :
Good compromises :
Usable still :
For the poor :