Downloads · 30 days
102
3% of all-time downloads
MakotoYuki/MYTHOS-26B-A4B-PRISM-PRO-DQ-GGUF
MYTHOS-26B-A4B-PRISM-PRO-DQ-GGUF is a image-text-to-text model from MakotoYuki. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
Downloads · 30 days
102
3% of all-time downloads
All-time downloads
3.4K
Public
Repo size
19.3 GB
Likes
2
Public
Click a slice to open those files.
.gguf19.3 GB · 100%
From the Hugging Face model README
Gemma 4 26B-A4B MoE PRISM-PRO-Dynamic-Quant
Created by Ex0bit
| Property | Value |
|---|---|
| Base Model | google/gemma-4-26B-A4B-it |
| Architecture | Gemma 4 MoE (128 experts, top-8 routing) |
| Parameters | 26B total / 4B active per token |
| Quantization | PRISM-PRO-DYNAMIC-QUANT |
| Achieved BPW | 5.73 |
| File Size | ~17 GB (language) + ~1.2 GB (vision projector) |
| Context Length | 262,144 tokens |
| Modalities | Text, Image, Video |
| Creator | Ex0bit |
Note: This 26B MoE variant does not include audio support. For audio, see the 31B dense variant.
| File | Size | Purpose |
|---|---|---|
mythos-26b-a4b-prism-pro-dq.gguf | 17 GB | Language model (quantized) |
mmproj-mythos-26b-a4b-prism-pro.gguf | 1.2 GB | Vision projector (F16) |
Both files are required for multimodal inference. For text-only use, only the language model file is needed.
This model uses PRISM-PRO Dynamic Quantization — a per-tensor-class mixed-precision allocation that assigns different quantization types to different tensor classes based on weight structure sensitivity.
Unlike uniform quantization (Q4_K_M, Q5_K_M), PRISM-DQ analyzes each tensor class's sensitivity and allocates precision where it matters most. Attention projections receive higher precision than FFN layers, with block-level overrides that protect critical layers.
The result: BF16-equivalent quality at 5.73 bits-per-weight — a 64% size reduction with zero measurable quality loss.
llama-mtmd-cli \
--model mythos-26b-a4b-prism-pro-dq.gguf \
--mmproj mmproj-mythos-26b-a4b-prism-pro.gguf \
--image path/to/image.jpg \
--prompt "Describe this image." \
-ngl 99
llama-server \
--model mythos-26b-a4b-prism-pro-dq.gguf \
--port 8080 -ngl 99
Download both mythos-26b-a4b-prism-pro-dq.gguf and mmproj-mythos-26b-a4b-prism-pro.gguf. LM Studio will automatically detect the vision projector for multimodal chat.
This model has been treated to remove bias, over-refusals and propaganda from the base google/gemma-4-26B-A4B-it using the State of The Art PRISM pipeline.
Apache 2.0 (inherited from google/gemma-4-26B-A4B-it)