Downloads · 30 days
18
8% of all-time downloads
Manel/Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Llama-3.1-8B-Instruct-Q4_K_M-GGUF is a machine learning model from Manel. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a converted model to GGUF from meta-llama/Llama-3.1-8B-Instruct quantized to Q4KM using llama.cpp library.
Downloads · 30 days
18
8% of all-time downloads
All-time downloads
229
Public
Repo size
4.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
This is a converted model to GGUF from meta-llama/Llama-3.1-8B-Instruct quantized to Q4_K_M using llama.cpp library.