Downloads · 30 days
264
10% of all-time downloads
jamiefutch/gemma-4-26B-A4B-it-MXFP4_MOE-GGUF
gemma-4-26B-A4B-it-MXFP4_MOE-GGUF is a image-text-to-text model from jamiefutch. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product.
These are MXFP4 quantizations of the model gemma-4-26B-A4B-it
Downloads · 30 days
264
10% of all-time downloads
All-time downloads
2.6K
Public
Repo size
52.8 GB
Likes
1
Public
Click a slice to open those files.
.gguf52.8 GB · 100%
From the Hugging Face model README
These are MXFP4 quantizations of the model gemma-4-26B-A4B-it
mmproj file, it is recommended to use the F32 version for the best visual processing results. F32 > BF16 > F16All variants use MXFP4 for the MoE (Mixture of Experts) weights to keep the model efficient. The difference lies in how the remaining tensors are handled:
| Variant | Quality | Performance | Size | Recommendation |
|---|---|---|---|---|
| BF16 | ⭐⭐⭐ | Variable* | 15.80GiB | Best for maximum accuracy; original unquantized weights. |
| F16 | ⭐⭐ | Fast | 15.80GiB | Great alternative if BF16 is slow on your hardware. |
| Q8 | ⭐ | Fastest | 14.36GiB | Balanced performance and memory usage. |
Note: On some older architectures, BF16 may be slower than F16.
Check that your GPU supports native BF16
Read the guide from unsloth in order to set up the model's recommended settings: