Downloads · 30 days
28
23% of all-time downloads
Llama-3.1-8B-Instruct-GGUF
beyond-logic-labs/Llama-3.1-8B-Instruct-GGUF
Llama-3.1-8B-Instruct-GGUF is a machine learning model from beyond-logic-labs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as llama3.1.
GGUF quantized version of Meta's Llama 3.1 8B Instruct for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible inference engines.
All-time downloads
122
Public
Repo size
7.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf7.3 GB · 100%
At a glance
- Library
- llama.cpp
- License
- llama3.1
- Access
- Public
- Created
- Jan 21, 2026
- Updated
- Jan 21, 2026
- SHA
- 75018714
Base models
Model card
From the Hugging Face model README
Llama 3.1 8B Instruct - GGUF
GGUF quantized version of Meta's Llama 3.1 8B Instruct for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible inference engines.
Available Quantizations
| Filename | Quant | Size | Description |
|---|---|---|---|
Llama-3.1-8B-Instruct-Q6_K.gguf | Q6_K | ~6.8 GB | High quality, recommended for most use cases |
Usage
Ollama
ollama run hf.co/beyond-logic-labs/Llama-3.1-8B-Instruct-GGUF:Q6_K
LM Studio
Download the GGUF file and load it directly in LM Studio.
llama.cpp
./llama-cli -m Llama-3.1-8B-Instruct-Q6_K.gguf -p "You are a helpful assistant." -cnv
Model Details
- Base Model: meta-llama/Llama-3.1-8B-Instruct
- Context Length: 128K tokens
- License: Llama 3.1 Community License
About Beyond Logic Labs
We build AI-powered tools for tabletop RPG players and game masters. Check out our other models for specialized RPG assistance.
- Library
- llama.cpp
- License
- llama3.1
- Languages
- en
- Created
- Jan 21, 2026
- Updated
- Jan 21, 2026