Downloads · 30 days
1
1% of all-time downloads
gfinin/llama-3.1-8b-greg-merged-v3-gguf
llama-3.1-8b-greg-merged-v3-gguf is a machine learning model from gfinin. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF quantizations of gfinin/llama-3.1-8b-greg-merged-v3, converted with llama.cpp tag master.
Downloads · 30 days
1
1% of all-time downloads
All-time downloads
186
Public
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf13.5 GB · 100%
From the Hugging Face model README
GGUF quantizations of gfinin/llama-3.1-8b-greg-merged-v3,
converted with llama.cpp tag master.
| Quant | File | Size |
|---|---|---|
| Q4_K_M | model-Q4_K_M.gguf | 4.92 GB |
| Q8_0 | model-Q8_0.gguf | 8.54 GB |
# Ollama
ollama run hf.co/gfinin/llama-3.1-8b-greg-merged-v3-gguf:Q4_K_M
# llama.cpp
llama-cli -m model-Q4_K_M.gguf -p "Your prompt here"