Downloads · 30 days
8
2% of all-time downloads
ochafik/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF
Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF is a machine learning model from ochafik. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a reconversion / quantization of https://huggingface.co/NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO
Downloads · 30 days
8
2% of all-time downloads
All-time downloads
339
Public
Repo size
28.4 GB
Likes
1
Public
Click a slice to open those files.
.gguf28.4 GB · 100%
From the Hugging Face model README
This is a reconversion / quantization of https://huggingface.co/NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO
There was a breaking change in llama.cpp's GGUF file format in https://github.com/ggerganov/llama.cpp/pull/6387 and the https://huggingface.co/NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF repo hasn't been updated since. This prevents one to memory-map the model, causing it to take much longer to load than needed when the file is already in the IO cache.