Downloads · 30 days
168
9% of all-time downloads
Artefact2/Yarn-Llama-2-70b-32k-GGUF
Yarn-Llama-2-70b-32k-GGUF is a machine learning model from Artefact2. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
These are GGUF quantized versions of NousResearch/Yarn-Llama-2-70b-32k.
Downloads · 30 days
168
9% of all-time downloads
All-time downloads
1.8K
Public
Repo size
302 GB
Likes
3
Public
Click a slice to open those files.
.gguf302 GB · 100%
From the Hugging Face model README
These are GGUF quantized versions of NousResearch/Yarn-Llama-2-70b-32k.
The importance matrix was trained for 512K tokens (1,000 batches of 512 tokens) using wiki.train.raw.
The IQ2_XXS and IQ2_XS versions are compatible with llama.cpp, version 147b17a or later.