Downloads · 30 days
35
14% of all-time downloads
librepowerai/Qwen3-1.7B-Power
Qwen3-1.7B-Power is a machine learning model from librepowerai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Qwen3-1.7B quantized to Q4KM with a Q6K output head for fast, accurate CPU inference on IBM Power — POWER9 (VSX) and POWER10/11 (MMA-accelerated) via LibrePower. No GPU required. Size: 1.2G.
Downloads · 30 days
35
14% of all-time downloads
All-time downloads
251
Public
Repo size
2.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.6 GB · 100%
From the Hugging Face model README
Qwen3-1.7B quantized to Q4_K_M with a Q6_K output head for fast, accurate CPU inference on IBM Power — POWER9 (VSX) and POWER10/11 (MMA-accelerated) via LibrePower. No GPU required. Size: 1.2G.
Ubuntu / Debian ppc64le:
curl -fsSL https://linux.librepower.org/install.sh | sudo sh
sudo apt install librepower-llama
wget https://huggingface.co/librepowerai/Qwen3-1.7B-Power/resolve/main/Qwen3-1.7B-Q4_K_M.gguf
lp-llama-completion -m Qwen3-1.7B-Q4_K_M.gguf -p "Hello!" -n 64 -t $(nproc)
IBM AIX 7.3 (big-endian):
dnf install llama-aix
wget https://huggingface.co/librepowerai/Qwen3-1.7B-Power/resolve/main/Qwen3-1.7B-Q4_K_M-be.gguf
lp-llama-completion -m Qwen3-1.7B-Q4_K_M-be.gguf -p "Hello!" -n 64 -t $(nproc)
Qwen3-1.7B-Q4_K_M.gguf — little-endian (Ubuntu/Linux ppc64le)Qwen3-1.7B-Q4_K_M-be.gguf — big-endian (IBM AIX)General chat, summarization, light coding; smallest fast assistant
Base model by its original authors (Apache-2.0). Quantization & Power packaging: LibrePower.