Downloads · 30 days
74
37% of all-time downloads
SmolLM3-3B-Power
librepowerai/SmolLM3-3B-Power
SmolLM3-3B-Power is a machine learning model from librepowerai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
SmolLM3-3B quantized to Q4KM with a Q6K output head for fast, accurate CPU inference on IBM Power — POWER9 (VSX) and POWER10/11 (MMA-accelerated) via LibrePower. No GPU required. Size: 1.8G.
All-time downloads
198
Public
Repo size
3.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf3.8 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026
- SHA
- 9bbb9540
Base models
Model card
From the Hugging Face model README
SmolLM3-3B — Q4_K_M for IBM Power (Linux ppc64le + AIX)
SmolLM3-3B quantized to Q4_K_M with a Q6_K output head for fast, accurate CPU inference on IBM Power — POWER9 (VSX) and POWER10/11 (MMA-accelerated) via LibrePower. No GPU required. Size: 1.8G.
Run it
Ubuntu / Debian ppc64le:
curl -fsSL https://linux.librepower.org/install.sh | sudo sh
sudo apt install librepower-llama
wget https://huggingface.co/librepowerai/SmolLM3-3B-Power/resolve/main/SmolLM3-3B-Q4_K_M.gguf
lp-llama-completion -m SmolLM3-3B-Q4_K_M.gguf -p "Hello!" -n 64 -t $(nproc)
IBM AIX 7.3 (big-endian):
dnf install llama-aix
wget https://huggingface.co/librepowerai/SmolLM3-3B-Power/resolve/main/SmolLM3-3B-Q4_K_M-be.gguf
lp-llama-completion -m SmolLM3-3B-Q4_K_M-be.gguf -p "Hello!" -n 64 -t $(nproc)
Files
SmolLM3-3B-Q4_K_M.gguf— little-endian (Ubuntu/Linux ppc64le)SmolLM3-3B-Q4_K_M-be.gguf— big-endian (IBM AIX)
Good for
Fully-open general assistant, multilingual, reasoning
Credits
Base model by its original authors (Apache-2.0). Quantization & Power packaging: LibrePower.
- License
- apache-2.0
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026