Skip to content

nmerkle

Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf

nmerkle/Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf

Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf is a machine learning model from nmerkle. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.

Tested inference on Raspberry PI Model 4 with llama.cpp. ~0.5 Tokens per second.

Downloads · 30 days

46

2% of all-time downloads

All-time downloads

3K

Public

Repo size

4.9 GB

Likes

5

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf4.9 GB · 100%

At a glance

License
llama3
Access
Public
Created
May 13, 2024
Updated
May 13, 2024
SHA
a208cc4a
License
llama3
Created
May 13, 2024
Updated
May 13, 2024