Downloads · 30 days
195
3% of all-time downloads
mistrjirka/Gemma-4-12B-PXQ-GGUF
Gemma-4-12B-PXQ-GGUF is a machine learning model from mistrjirka. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
PXA/PXQ GGUF quantizations derived from google/gemma-4-12B.
Downloads · 30 days
195
3% of all-time downloads
All-time downloads
5.9K
Public
Repo size
32.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf32.7 GB · 100%
From the Hugging Face model README
PXA/PXQ GGUF quantizations derived from google/gemma-4-12B.
These are GGUF containers containing PXA-specific PXQ tensor types; stock upstream llama.cpp does not support these PXQ codecs.
mistrjirka/llama.cpp v100-optimized — https://github.com/mistrjirka/llama.cpp/tree/v100-optimized — a current llama.cpp-based runtime focused on NVIDIA Volta (SM70) and Turing (SM75), tested primarily on Tesla V100 and RTX 2080 Ti. The branch implements the complete published PXQ tensor family, not just PXQ4.| PXQ tier | PXA | mistrjirka/llama.cpp v100-optimized |
|---|---|---|
| PXQ1 | Supported | Supported |
| PXQ2 | Supported | Supported |
| PXQ3 | Supported | Supported |
| PXQ4 | Supported | Supported |
| PXQ4-HQ | Supported | Supported |
| PXQ6 | Supported | Supported |
Both runtimes also understand mixed files containing multiple PXQ tensor tiers. Performance and fast-path coverage still depend on GPU architecture and tensor shape; "supported" here means the PXQ wire type and execution path exist, not that every tier is equally optimized on every GPU.
PXQ4 is the normal default. PXQ4-HQ and PXQ6 trade more space for fidelity; PXQ3 and PXQ2 trade fidelity for smaller files. PXQ1 is only published if PXA actually emits PXQ1 tensors for this architecture.
The codec bpw describes the PXQ tensors, not necessarily the complete-file effective bpw: sensitive or structurally unsuitable tensors may deliberately remain Q6_K, Q8_0, F16/F32, etc.
| Filename | Tier | PXQ codec | File size | Description |
|---|---|---|---|---|
Gemma-4-12B-PXQ2-GGUF.gguf | PXQ2 | ~2.27 bpw | 4.42 GB | Aggressive LM4 × E16-row tier. |
Gemma-4-12B-PXQ3-GGUF.gguf | PXQ3 | ~3.27 bpw | 5.70 GB | Lower-bit LM8 bit-plane × E16-row tier. |
Gemma-4-12B-PXQ4-GGUF.gguf | PXQ4 | ~4.27 bpw | 6.98 GB | Recommended core 4-bit PX16 × E16-row tier. |
Gemma-4-12B-PXQ4-HQ-GGUF.gguf | PXQ4-HQ | ~4.52 bpw | 7.30 GB | Higher-fidelity PXQ4 with finer bs8 sub-scales. |
Gemma-4-12B-PXQ6-GGUF.gguf | PXQ6 | ~5.27 bpw | 8.26 GB | Quality-first 5-bit LM32 × E16-row tier. |
All model filenames explicitly contain GGUF.
Each artifact is processed independently. Publishing is pipelined with a maximum of one upload + one quantization at a time:
The pipeline is disk-bounded: it never intentionally gets more than one uploading quant plus one next quant ahead.
PXA revision used by this queue job: 25d34eeab1a418fd21411158400a40d057ab063f.