Downloads · 30 days
46
25% of all-time downloads
NexesQuants/Mixtral-8x22B-v0.1-iMat.GGUF
Mixtral-8x22B-v0.1-iMat.GGUF is a machine learning model from NexesQuants. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF Quants for https://huggingface.co/mistralai/Mixtral-8x22B-v0.1
Downloads · 30 days
46
25% of all-time downloads
All-time downloads
181
Public
Repo size
95.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf95.9 GB · 100%
From the Hugging Face model README
GGUF Quants for https://huggingface.co/mistralai/Mixtral-8x22B-v0.1
These quants are experimental, and compete with IQ1_M standard quants in terms of quality.
Target public is those with 36GB of VRAM.