Downloads · 30 days
45
2% of all-time downloads
Meta-Llama-3.1-8B-Instruct.Q4_0_4_8.gguf
gbueno86/Meta-Llama-3.1-8B-Instruct.Q4_0_4_8.gguf
Meta-Llama-3.1-8B-Instruct.Q4_0_4_8.gguf is a machine learning model from gbueno86. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
Sources: https://www.reddit.com/r/LocalLLaMA/comments/1ebnkds/llamacppandroidusersnowbenefitfromfaster/ https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md
All-time downloads
2K
Public
Repo size
4.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf4.7 GB · 100%
At a glance
- License
- llama3.1
- Access
- Public
- Created
- Jul 26, 2024
- Updated
- Jul 26, 2024
- SHA
- be84a61b
Model card
From the Hugging Face model README
Sources: https://www.reddit.com/r/LocalLLaMA/comments/1ebnkds/llamacpp_android_users_now_benefit_from_faster/ https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md
- For Q4_0_4_4 quantization type build, add the GGML_NO_LLAMAFILE=1 flag. For example, use make GGML_NO_LLAMAFILE=1.
- License
- llama3.1
- Created
- Jul 26, 2024
- Updated
- Jul 26, 2024