Downloads · 30 days
0
kermelp/Huihui-gemma-4-E2B-it-abliterated-ONNX
Huihui-gemma-4-E2B-it-abliterated-ONNX is a image-text-to-text model from kermelp. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.js. The card lists the license as apache-2.0.
ONNX export of huihui-ai/Huihui-gemma-4-E2B-it-abliterated (uncensored / abliterated version of google/gemma-4-E2B-it) for use with Transformers.js in the browser via WebGPU.
Downloads · 30 days
0
Access
Public
Updated Aug 22, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
.ipynb8.6 KB · 73%
From the Hugging Face model README
ONNX export of huihui-ai/Huihui-gemma-4-E2B-it-abliterated (uncensored / abliterated version of google/gemma-4-E2B-it) for use with Transformers.js in the browser via WebGPU.
Live demo: kermelp/Huihui-gemma4-abliterated-webgpu
import { AutoProcessor, Gemma4ForConditionalGeneration, TextStreamer } from "@huggingface/transformers";
const model_id = "kermelp/Huihui-gemma-4-E2B-it-abliterated-ONNX";
const processor = await AutoProcessor.from_pretrained(model_id);
const model = await Gemma4ForConditionalGeneration.from_pretrained(model_id, {
dtype: "q4f16",
device: "webgpu",
});
const messages = [
{
role: "user",
content: [{ type: "image" }, { type: "text", text: "Describe this image." }],
},
];
const prompt = processor.apply_chat_template(messages, {
enable_thinking: false,
add_generation_prompt: true,
});
Converted from bf16 safetensors with optimum-cli export onnx --task image-text-to-text,
then quantized to 4-bit weights + fp16 activations (q4f16) with onnxruntime MatMulNBitsQuantizer.
⚠️ This model has had its refusal behavior removed via abliteration. It will answer prompts the original Gemma 4 refuses. For research and evaluation only.