Downloads · 30 days
374
8% of all-time downloads
mistrjirka/Ornith-1.5-35B-A3B-PXQ-GGUF
Ornith-1.5-35B-A3B-PXQ-GGUF is a machine learning model from mistrjirka. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
PXA/PXQ GGUF quantizations derived from ornith-ai/Ornith-1.5-35B-A3B.
Downloads · 30 days
374
8% of all-time downloads
All-time downloads
4.7K
Public
Repo size
97 GB
Likes
0
Public
Click a slice to open those files.
.gguf97 GB · 100%
From the Hugging Face model README
PXA/PXQ GGUF quantizations derived from ornith-ai/Ornith-1.5-35B-A3B.
These are GGUF containers containing PXA-specific PXQ tensor types; stock upstream llama.cpp does not support these PXQ codecs.
mistrjirka/llama.cpp v100-optimized — https://github.com/mistrjirka/llama.cpp/tree/v100-optimized — a current llama.cpp-based runtime focused on NVIDIA Volta (SM70) and Turing (SM75), tested primarily on Tesla V100 and RTX 2080 Ti. The branch implements the complete published PXQ tensor family, not just PXQ4.| PXQ tier | PXA | mistrjirka/llama.cpp v100-optimized |
|---|---|---|
| PXQ1 | Supported | Supported |
| PXQ2 | Supported | Supported |
| PXQ3 | Supported | Supported |
| PXQ4 | Supported | Supported |
| PXQ4-HQ | Supported | Supported |
| PXQ6 | Supported | Supported |
Both runtimes also understand mixed files containing multiple PXQ tensor tiers. Performance and fast-path coverage still depend on GPU architecture and tensor shape; "supported" here means the PXQ wire type and execution path exist, not that every tier is equally optimized on every GPU.
PXQ4 is the normal default. PXQ4-HQ and PXQ6 trade more space for fidelity; PXQ3 and PXQ2 trade fidelity for smaller files. PXQ1 is only published if PXA actually emits PXQ1 tensors for this architecture.
The codec bpw describes the PXQ tensors, not necessarily the complete-file effective bpw: sensitive or structurally unsuitable tensors may deliberately remain Q6_K, Q8_0, F16/F32, etc.
| Filename | Tier | PXQ codec | File size | Description |
|---|---|---|---|---|
Ornith-1.5-35B-A3B-PXQ1-GGUF.gguf | PXQ1 | ~1.26 bpw | 6.92 GB | Sub-2-bit 1-bit-sign × E16-row stretch tier. |
Ornith-1.5-35B-A3B-PXQ2-GGUF.gguf | PXQ2 | ~2.27 bpw | 11.20 GB | Aggressive LM4 × E16-row tier. |
Ornith-1.5-35B-A3B-PXQ3-GGUF.gguf | PXQ3 | ~3.27 bpw | 15.37 GB | Lower-bit LM8 bit-plane × E16-row tier. |
Ornith-1.5-35B-A3B-PXQ4-GGUF.gguf | PXQ4 | ~4.27 bpw | 19.45 GB | Recommended core 4-bit PX16 × E16-row tier. |
Ornith-1.5-35B-A3B-PXQ4-HQ-GGUF.gguf | PXQ4-HQ | ~4.52 bpw | 20.49 GB | Higher-fidelity PXQ4 with finer bs8 sub-scales. |
Ornith-1.5-35B-A3B-PXQ6-GGUF.gguf | PXQ6 | ~5.27 bpw | 23.58 GB | Quality-first 5-bit LM32 × E16-row tier. |
All model filenames explicitly contain GGUF.
Each artifact is processed independently. Publishing is pipelined with a maximum of one upload + one quantization at a time:
The pipeline is disk-bounded: it never intentionally gets more than one uploading quant plus one next quant ahead.
PXA revision used by this queue job: 25d34eeab1a418fd21411158400a40d057ab063f.
None.