Downloads · 30 days
14
10% of all-time downloads
Llama-3.2-3B-Instruct-home16k-GGUF
RockMan256/Llama-3.2-3B-Instruct-home16k-GGUF
Llama-3.2-3B-Instruct-home16k-GGUF is a machine learning model from RockMan256. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama-cpp.
GGUF quantization of RockMan256/Llama-3.2-3B-Instruct-home16k.
All-time downloads
140
Public
Repo size
2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2 GB · 100%
At a glance
- Library
- llama-cpp
- Access
- Public
- Created
- Jul 11, 2026
- Updated
- Jul 11, 2026
- SHA
- c540afa4
Base models
Model card
From the Hugging Face model README
Llama-3.2-3B-Instruct-home16k-GGUF
GGUF quantization of RockMan256/Llama-3.2-3B-Instruct-home16k.
Converted using llama.cpp.
Files
| File | Type | Size |
|---|---|---|
llama-3.2-3B-Instruct-home16k-Q4_K_M.gguf | Text model (Q4_K_M) | 1.92 GB |
Usage
llama.cpp CLI
./llama-server \
-m llama-3.2-3B-Instruct-home16k-Q4_K_M.gguf \
--host 0.0.0.0 --port 8080
Open WebUI
- Go to Settings > Connections > Model Ollama
- Set the API URL to your llama.cpp server endpoint
- Upload
llama-3.2-3B-Instruct-home16k-Q4_K_M.gguf
Source Model
- Base: meta-llama/Llama-3.2-3B-Instruct
- Fine-tuned: RockMan256/Llama-3.2-3B-Instruct-home16k (16k context, Unsloth fine-tuned)
- Library
- llama-cpp
- Created
- Jul 11, 2026
- Updated
- Jul 11, 2026