Downloads · 30 days
16
24% of all-time downloads
Llama-3.2-3B-Instruct-q5_0-GGUF
am00r/Llama-3.2-3B-Instruct-q5_0-GGUF
Llama-3.2-3B-Instruct-q5_0-GGUF is a text generation model from am00r. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as llama3.2.
meta-llama/Llama-3.2-3B-Instruct converted to GGUF f16, then quantized to Q50 with llama.cpp's llama-quantize.
All-time downloads
67
Public
Repo size
2.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- llama3.2
- Access
- Public
- Created
- May 19, 2026
- Updated
- Aug 31, 2026
- SHA
- f8f8a9bb
Try a prompt
Base models
Model card
From the Hugging Face model README
Llama-3.2-3B-Instruct — Q5_0 (GGUF)
meta-llama/Llama-3.2-3B-Instruct converted to GGUF f16, then quantized to Q5_0 with llama.cpp's llama-quantize.
llama-cli -m llama3.2-3b-instruct-q5_0.gguf -p "Hello"
MSc thesis artifact on compression of small language models. Built with Llama, under the Llama 3.2 Community License.
- Task
- Text Generation
- Library
- gguf
- License
- llama3.2
- Created
- May 19, 2026
- Updated
- Aug 31, 2026