Downloads · 30 days
25
1% of all-time downloads
Clevyby/Moistral-11B-v3-Q5_K_S-GGUF-iMatrix
Moistral-11B-v3-Q5_K_S-GGUF-iMatrix is a text generation model from Clevyby. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repo hosts only a Q5KS of Moistral 11b v3. GGUF quant is from MarsupialAI/Moistral-11B-v3iMatrixGGUF. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpphf.
Downloads · 30 days
25
1% of all-time downloads
All-time downloads
2.9K
Public
Repo size
102 GB
Likes
0
Public
Click a slice to open those files.
.gguf7.4 GB · 100%
From the Hugging Face model README
This repo hosts only a Q5_K_S of Moistral 11b v3. GGUF quant is from MarsupialAI/Moistral-11B-v3_iMatrix_GGUF. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.