Downloads · 30 days
56
5% of all-time downloads
patf82/Nous-Hermes-2-Yi-34B-IQ3-imatrix-GGUF
Nous-Hermes-2-Yi-34B-IQ3-imatrix-GGUF is a machine learning model from patf82. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Created using llama.cpp 9e359a4f, with default settings of both convert.py and quantize using the imatrix provided by ikawrakow.
Downloads · 30 days
56
5% of all-time downloads
All-time downloads
1K
Public
Repo size
30.6 GB
Likes
1
Public
Click a slice to open those files.
.gguf30.6 GB · 100%
From the Hugging Face model README
Created using llama.cpp 9e359a4f, with default settings of both convert.py and quantize using the imatrix provided by ikawrakow.
See https://github.com/ggerganov/llama.cpp/pull/5676 for information on the IQ3 quantization.