Downloads · 30 days
442
2% of all-time downloads
duyntnet/Llama-2-7b-chat-hf-imatrix-GGUF
Llama-2-7b-chat-hf-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
Downloads · 30 days
442
2% of all-time downloads
All-time downloads
20.7K
Public
Repo size
93.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf93.1 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
Intended Use Cases Llama 2 is intended for commercial and research use in English. Tuned models are intended for assistant-like chat, whereas pretrained models can be adapted for a variety of natural language generation tasks.
To get the expected features and performance for the chat versions, a specific formatting needs to be followed, including the INST and <<SYS>> tags, BOS and EOS tokens, and the whitespaces and breaklines in between (we recommend calling strip() on inputs to avoid double-spaces). See our reference code in github for details: chat_completion.