Downloads · 30 days
52
29% of all-time downloads
Granite-3.3-2B-Instruct-Power
librepowerai/Granite-3.3-2B-Instruct-Power
Granite-3.3-2B-Instruct-Power is a machine learning model from librepowerai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
IBM Granite 3.3 2B Instruct — a dense transformer, quantized to Q4KM with a Q6K output head for fast CPU inference on IBM Power (POWER9 VSX, POWER10/11 MMA-accelerated) via LibrePower. No GPU. Size: 1.5G. Apache-2.0,…
All-time downloads
182
Public
Repo size
3.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf3.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026
- SHA
- 17ec2fc3
Base models
Model card
From the Hugging Face model README
Granite-3.3-2B-Instruct — Q4_K_M for IBM Power (Linux ppc64le + AIX)
IBM Granite 3.3 2B Instruct — a dense transformer, quantized to Q4_K_M with a Q6_K output head for fast CPU inference on IBM Power (POWER9 VSX, POWER10/11 MMA-accelerated) via LibrePower. No GPU. Size: 1.5G. Apache-2.0, cryptographically signed by IBM.
Run it
Ubuntu / Debian ppc64le:
curl -fsSL https://linux.librepower.org/install.sh | sudo sh
sudo apt install librepower-llama
wget https://huggingface.co/librepowerai/Granite-3.3-2B-Instruct-Power/resolve/main/Granite-3.3-2B-Instruct-Q4_K_M.gguf
lp-llama-completion -m Granite-3.3-2B-Instruct-Q4_K_M.gguf -p "Hello!" -n 64 -t $(nproc)
IBM AIX 7.3 (big-endian):
dnf install llama-aix
wget https://huggingface.co/librepowerai/Granite-3.3-2B-Instruct-Power/resolve/main/Granite-3.3-2B-Instruct-Q4_K_M-be.gguf
lp-llama-completion -m Granite-3.3-2B-Instruct-Q4_K_M-be.gguf -p "Hello!" -n 64 -t $(nproc)
Good for
IBM's own dense small model: enterprise chat, RAG, structured JSON, classification/routing — Apache-2.0, signed
Credits
Base model: IBM Granite (Apache-2.0). Quantization & Power packaging: LibrePower.
- License
- apache-2.0
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026