Downloads · 30 days
400
3% of all-time downloads
Lewdiculous/Eris_PrimeV4.69-Vision-32k-7B-GGUF-Imatrix
Eris_PrimeV4.69-Vision-32k-7B-GGUF-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
These are quants for an experimental model.
Downloads · 30 days
400
3% of all-time downloads
All-time downloads
14.8K
Public
Repo size
51.3 GB
Likes
7
Public
Click a slice to open those files.
.gguf51.3 GB · 100%
From the Hugging Face model README
These are quants for an experimental model.
quantization_options = [
"Q4_K_M", "Q4_K_S", "IQ4_XS",
"Q5_K_M", "Q5_K_S",
"Q6_K", "Q8_0"
]
Original model weights and information: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4.69-Vision-32k-7B
MMPROJ: <br> ./mmproj/mmproj-model-f16.gguf

If you want to use vision functionality:
To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo.
