Skip to content

xbill9

gemma-4-26B-A4B-it-inferentia2-int8

xbill9/gemma-4-26B-A4B-it-inferentia2-int8

gemma-4-26B-A4B-it-inferentia2-int8 is a text generation model from xbill9. Use it when you need the model to write or continue text. It is set up for torch-neuronx. The card lists the license as apache-2.0.

An int8-quantized-expert build of google/gemma-4-26B-A4B-it for inf2.24xlarge (TP=8). The 128 MoE experts are quantized to per-channel symmetric int8; every other weight stays bf16. Greedy decode is token-for-token id…

Downloads · 30 days

0

Access

Public

Updated Jul 16, 2026

Repo size

93.5 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors51.6 GB · 55%

At a glance

Task
Text Generation
Library
torch-neuronx
License
apache-2.0
Access
Public
Created
Jul 16, 2026
Updated
Jul 16, 2026
SHA
a1155ff1

Try a prompt

Base models

Task
Text Generation
Library
torch-neuronx
License
apache-2.0
Created
Jul 16, 2026
Updated
Jul 16, 2026