Downloads · 30 days
31
34% of all-time downloads
Llama-3.2-3B-q5_0-GGUF
am00r/Llama-3.2-3B-q5_0-GGUF
Llama-3.2-3B-q5_0-GGUF is a text generation model from am00r. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as llama3.2.
meta-llama/Llama-3.2-3B converted to GGUF f16, then quantized to Q50 with llama.cpp's llama-quantize.
All-time downloads
91
Public
Repo size
2.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- llama3.2
- Access
- Public
- Created
- Aug 31, 2026
- Updated
- Aug 31, 2026
- SHA
- 755edcfd
Try a prompt
Base models
Model card
From the Hugging Face model README
Llama-3.2-3B — Q5_0 (GGUF)
meta-llama/Llama-3.2-3B converted to GGUF f16, then quantized to Q5_0 with llama.cpp's llama-quantize.
llama-cli -m llama3.2-3b-q5_0.gguf -p "Hello"
MSc thesis artifact on compression of small language models. Built with Llama, under the Llama 3.2 Community License.
- Task
- Text Generation
- Library
- gguf
- License
- llama3.2
- Created
- Aug 31, 2026
- Updated
- Aug 31, 2026