Downloads · 30 days
12
7% of all-time downloads
Llama-2-7b-chat-hf-GGUF
jeffmcc/Llama-2-7b-chat-hf-GGUF
Llama-2-7b-chat-hf-GGUF is a machine learning model from jeffmcc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
This repo contains GGUF format, quantized model files for Meta's Llama 2 7B LLM. The files were generated using the hf-to-gguf project on GitHub which facilitates the conversion of LLMs stored in Hugging Face into GGU…
All-time downloads
168
Public
Repo size
21.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf21.6 GB · 100%
At a glance
- License
- llama2
- Access
- Public
- Created
- Feb 8, 2024
- Updated
- Feb 9, 2024
- SHA
- 4ce3469e
Model card
From the Hugging Face model README
Llama-2-7b-chat-hf-GGUF
This repo contains GGUF format, quantized model files for Meta's Llama 2 7B LLM. The files were generated using the hf-to-gguf project on GitHub which facilitates the conversion of LLMs stored in Hugging Face into GGUF while providing traceability and reproducibility. Each model file has an accompanying JSON config file containing the source and version of the model being converted, version of conversion scripts, quantization method, and anything else needed to fully reproduce the converted model. Keeping the JSON config file with the GGUF model file anywhere the model is deployed can be useful for use cases that require tight version control and reproducibility.
Downloading model and JSON config files from the command line
Install the huggingface_hub Python library:
pip3 install huggingface_hub
Download the model and JSON config file for a specific quantization:
huggingface-cli download jeffmcc/Llama-2-7b-chat-hf-GGUF --local-dir . --local-dir-use-symlinks False --include='*q4_k_m*'
- License
- llama2
- Languages
- en
- Created
- Feb 8, 2024
- Updated
- Feb 9, 2024