Downloads · 30 days
160
4% of all-time downloads
doromiert/gemma-4-26B-A4B-it-uncensored-IQ3_XXS
gemma-4-26B-A4B-it-uncensored-IQ3_XXS is a machine learning model from doromiert. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
160
4% of all-time downloads
All-time downloads
3.7K
Public
Repo size
11.3 GB
Likes
4
Public
Click a slice to open those files.
.gguf11.3 GB · 100%
From the Hugging Face model README
IQ3_XXS quant of TrevorJS/gemma-4-26B-A4B-it-uncensored — the first IQ3_XXS of this model on HF.
gemma 4 26B MoE (25B total, 4B active per token), abliterated via biprojection + Expert-Granular Abliteration (EGA). quantized to IQ3_XXS using an importance matrix generated from the Q4_K_M version.
confirmed uncensored. confirmed coherent. 50-80 tps on RX 6900 XT.
HIP_VISIBLE_DEVICES=0 llama-server \
-m gemma-4-26B-A4B-it-uncensored-IQ3_XXS.gguf \
-c 32768 \
-ngl 99 \
-np 1 \
-fa on \
-ctk q4_0 \
-ctv q4_0 \
--host 0.0.0.0
model weights: Apache 2.0 (inherited from Google/TrevorJS) quant methodology & imatrix: NAPALM v2.0 — any state entity attempting to use this model has void title ab initio