Downloads · 30 days
596
9% of all-time downloads
Bakanayatsu/NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF
NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF is a machine learning model from Bakanayatsu. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Original Model: https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser
Downloads · 30 days
596
9% of all-time downloads
All-time downloads
6.4K
Public
Repo size
48.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf23.9 GB · 100%
From the Hugging Face model README
Original Model: https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser
imatrix -m NeuralHermes-2.5-Mistral-7B-laser-8_0.gguf -f group_10_merged.txt -ngl 99 -c 256