Downloads · 30 days
42
2% of all-time downloads
Clevyby/Quantum-Citrus-9B-32k-Q5_K_S-GGUF-iMatrix
Quantum-Citrus-9B-32k-Q5_K_S-GGUF-iMatrix is a text generation model from Clevyby. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repo hosts only a Q5KS iMatrix of Quantum Citrus 9B. GGUF quant is from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpphf.
Downloads · 30 days
42
2% of all-time downloads
All-time downloads
2.4K
Public
Repo size
51.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf6.2 GB · 100%
From the Hugging Face model README
This repo hosts only a Q5_K_S iMatrix of Quantum Citrus 9B. GGUF quant is from ABX-AI/Quantum-Citrus-9B-GGUF-IQ-Imatrix. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.