gemma-4-26B-A4B-text-GGUF

potto007/gemma-4-26B-A4B-text-GGUF

gemma-4-26B-A4B-text-GGUF is a image-text-to-text model from potto007. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

Using <a href="https://github.com/ggml-org/llama.cpp/"llama.cpp</a release <a href="https://github.com/ggml-org/llama.cpp/releases/tag/b9352"b9352</a for quantization.

Downloads · 30 days

8% of all-time downloads

All-time downloads

898

Public

Repo size

100 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf100 GB · 100%

At a glance

Task: Image-Text-to-Text
License: apache-2.0
Access: Public
Created: May 29, 2026
Updated: May 30, 2026
SHA: 8ba4d863

Try a prompt

Base models

google/gemma-4-26B-A4B-it

Model card

From the Hugging Face model README

Llamacpp Quantizations of gemma-4-26B-A4B-it by google

Using <a href="https://github.com/ggml-org/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggml-org/llama.cpp/releases/tag/b9352">b9352</a> for quantization.

Vision tower (VLM) stripped for lighter local operation. Stripped using forked version of REAP (https://github.com/potto007/reap/tree/gemma4-reap-support).

Original model: https://huggingface.co/google/gemma-4-26B-A4B-it

Run them in your choice of tools:

Prompt format

<bos><|turn>system
{system_prompt}<turn|>
<|turn>user
{prompt}<turn|>
<|turn>model
<|channel>thought
<channel|>

Download a file (not the whole branch) from below:

Filename	Quant type	File Size	Split	Description
gemma-4-26B-A4B-text-f16.gguf	bf16	50.5GB	true	Full BF16 weights.
gemma-4-26B-A4B-text-Q8_0.gguf	Q8_0	26.9GB	false	Extremely high quality, generally unneeded but max available quant.
gemma-4-26B-A4B-text-Q6_K.gguf	Q6_K	22.8GB	false	Uses Q8_0 for embed and output weights. Very high quality, near perfect, recommended.

Downloading using huggingface-cli

<details> <summary>Click to view download instructions</summary>

First, make sure you have hugginface-cli installed:

pip install -U "huggingface_hub[cli]"

Then, you can target the specific file you want:

huggingface-cli download potto007/gemma-4-26B-A4B-text-GGUF --include "gemma-4-26B-A4B-text-Q8_0.gguf" --local-dir ./

You can either specify a new local-dir (gemma-4-26B-A4B-it-Q8_0) or download them all in place (./)

</details>

Task: Image-Text-to-Text
License: apache-2.0
Created: May 29, 2026
Updated: May 30, 2026