Downloads · 30 days
46
2% of all-time downloads
nmerkle/Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf
Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf is a machine learning model from nmerkle. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
Tested inference on Raspberry PI Model 4 with llama.cpp. ~0.5 Tokens per second.
Downloads · 30 days
46
2% of all-time downloads
All-time downloads
3K
Public
Repo size
4.9 GB
Likes
5
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
Tested inference on Raspberry PI Model 4 with llama.cpp. ~0.5 Tokens per second.