Downloads · 30 days
12
3% of all-time downloads
Tess-Mixtral-8x22B-imatrix-gguf
nisten/Tess-Mixtral-8x22B-imatrix-gguf
Tess-Mixtral-8x22B-imatrix-gguf is a machine learning model from nisten. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
iMatrix gguf quants of a newer finetune of Mixtral-8x22B
All-time downloads
365
Public
Repo size
399 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.part0198 GB · 49%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 14, 2024
- Updated
- Apr 14, 2024
- SHA
- e412f327
Base models
Model card
From the Hugging Face model README
iMatrix gguf quants of a newer finetune of Mixtral-8x22B
EdgeQuants still underway, IQ4XS version recommended. Make sure to combine/merge the parts back together before using
cat tessIQ4XS.gguf.part* > tessIQ4XS.gguf
Then use with llama.cpp version from April 12 or older. April 13 release had massive changes and messed up inferene for MoE models
- License
- apache-2.0
- Created
- Apr 14, 2024
- Updated
- Apr 14, 2024