Downloads · 30 days
179
2% of all-time downloads
Lewdiculous/FuseChat-Kunoichi-10.7B-GGUF-IQ-Imatrix
FuseChat-Kunoichi-10.7B-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository hosts GGUF-IQ-Imatrix quantizations for Virt-io/FuseChat-Kunoichi-10.7B.
Downloads · 30 days
179
2% of all-time downloads
All-time downloads
8.9K
Public
Repo size
93.2 GB
Likes
7
Public
Click a slice to open those files.
.gguf93.1 GB · 100%
From the Hugging Face model README
This repository hosts GGUF-IQ-Imatrix quantizations for Virt-io/FuseChat-Kunoichi-10.7B.
Uploaded:
quantization_options = [
"Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M",
"Q5_K_S", "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XS", "IQ3_XXS"
]
