Downloads · 30 days
13
20% of all-time downloads
am00r/Llama-3.2-3B-Instruct-GGUF
Llama-3.2-3B-Instruct-GGUF is a text generation model from am00r. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as llama3.2.
meta-llama/Llama-3.2-3B-Instruct converted to GGUF f16 with llama.cpp's converthftogguf.py. Unquantized baseline.
Downloads · 30 days
13
20% of all-time downloads
All-time downloads
64
Public
Repo size
7.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf6.4 GB · 100%
From the Hugging Face model README
meta-llama/Llama-3.2-3B-Instruct converted to GGUF f16 with llama.cpp's convert_hf_to_gguf.py. Unquantized baseline.
llama-cli -m llama3.2-3b-instruct-f16.gguf -p "Hello"
MSc thesis artifact on compression of small language models. Built with Llama, under the Llama 3.2 Community License.