Downloads · 30 days
8
5% of all-time downloads
NexesQuants/NousResearch_Yarn-Llama-2-70b-32k-iMat.GGUF
NousResearch_Yarn-Llama-2-70b-32k-iMat.GGUF is a machine learning model from NexesQuants. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF Quants with iMatrix for : https://huggingface.co/NousResearch/Yarn-Llama-2-70b-32k
Downloads · 30 days
8
5% of all-time downloads
All-time downloads
156
Public
Repo size
14.5 GB
Likes
2
Public
Click a slice to open those files.
.gguf14.5 GB · 100%
From the Hugging Face model README
GGUF Quants with iMatrix for : https://huggingface.co/NousResearch/Yarn-Llama-2-70b-32k
iMatrix (Wiki-c512-ch1k) courtesy of Artefact2.
Quant :
Other quants :