Downloads · 30 days
195
4% of all-time downloads
Ex0bit/Elbaz-GLM-4.6V-Flash-PRISM
Elbaz-GLM-4.6V-Flash-PRISM is a image-text-to-text model from Ex0bit. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
<p align="center" <img src="https://raw.githubusercontent.com/zai-org/GLM-V/refs/heads/main/resources/logo.svg" width="400"/ </p
Downloads · 30 days
195
4% of all-time downloads
All-time downloads
4.8K
Public
Repo size
19.5 GB
Likes
6
Public
Click a slice to open those files.
.gguf7.1 GB · 100%
From the Hugging Face model README
GLM-4.6V-Flash: A 10B Dense Vision-Language Model
GLM-4.6V-Flash is a 10.29B parameter dense Vision-Language Model (VLM) with a 40-layer transformer architecture and integrated vision encoder, capable of understanding both text and images.
This model is an abliterated version of zai-org/GLM-4.6V-Flash that has had its refusal mechanisms removed using PRISM (Projected Refusal Isolation via Subspace Modification). The model will respond to prompts that the original model would refuse.
Key Specs:
This project exists as research and development experimentation into understanding how large language models encode and enforce refusal behaviors, contributing to broader AI safety research by providing empirical data on refusal mechanism localization and tradeoffs between safety and capability.
Eric Elbaz (Ex0bit)
zai-org/GLM-4.6V-Flash (Base Model - BF16)
└── Ex0bit/Elbaz-GLM-4.6V-Flash-PRISM (This Model)
└── Elbaz-GLM-4.6V-Flash-PRISM-IQ4_XS.gguf
| Quantization | Size | Description |
|---|---|---|
| IQ4_XS | 5.0 GB | Importance-weighted 4-bit, excellent quality |
The IQ4_XS quantization uses importance-weighted quantization which provides better quality than standard Q4 quantizations at similar sizes. Embedding and output layers use Q6_K precision for optimal quality.
This model uses the GLM chat format with optional thinking/reasoning support:
[gMASK]<sop><|system|>
{system_prompt}<|user|>
{user_prompt}<|assistant|>
| Component | Token/Format |
|---|---|
| System Start | <|system|> |
| User Start | <|user|> |
| Assistant Start | <|assistant|> |
| Thinking Start | <think> |
| Thinking End | </think> |
| End of Text | <|endoftext|> |
| Token | ID | Purpose |
|---|---|---|
<|system|> | 151335 | System prompt marker |
<|user|> | 151336 | User message marker |
<|assistant|> | 151337 | Assistant response marker |
<think> | 151350 | Reasoning block start |
</think> | 151351 | Reasoning block end |
<|endoftext|> | 151329 | EOS token |
<|begin_of_image|> | 151339 | Image input start |
<|end_of_image|> | 151340 | Image input end |
| Metric | Result |
|---|---|
| Refusal Bypass Rate | 100% |
| English Output Rate | 100% |
| KL Divergence | 0.0000 (no capability degradation) |
| Response Coherence | Detailed, technically accurate |
Testing shows that PRISM abliteration maintains full model coherence with no measurable capability degradation.
# Download the model
huggingface-cli download Ex0bit/Elbaz-GLM-4.6V-Flash-PRISM \
Elbaz-GLM-4.6V-Flash-PRISM-IQ4_XS.gguf \
--local-dir .
# Run inference
./llama-cli -m Elbaz-GLM-4.6V-Flash-PRISM-IQ4_XS.gguf \
-p "[gMASK]<sop><|system|>
You are a helpful assistant. You MUST respond in English only.<|user|>
Your prompt here<|assistant|>
" \
-n 2048 \
--temp 0.7 \
-ngl 999
# Start the server
./llama-server -m Elbaz-GLM-4.6V-Flash-PRISM-IQ4_XS.gguf \
--host 0.0.0.0 \
--port 8080 \
-ngl 999 \
-c 32768
# Example API call
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"messages": [
{"role": "system", "content": "You are a helpful assistant. You MUST respond in English only."},
{"role": "user", "content": "Your prompt here"}
],
"temperature": 0.7
}'
# Pull and run directly from Hugging Face
ollama pull hf.co/Ex0bit/Elbaz-GLM-4.6V-Flash-PRISM
ollama run hf.co/Ex0bit/Elbaz-GLM-4.6V-Flash-PRISM
Note: The
hf.co/prefix is required to pull from Hugging Face. Requires Ollama 0.3.0+.
from transformers import AutoModelForCausalLM, AutoProcessor
model_id = "Ex0bit/Elbaz-GLM-4.6V-Flash-PRISM"
processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto", trust_remote_code=True)
messages = [
{"role": "system", "content": [{"type": "text", "text": "You are a helpful assistant. You MUST respond in English only."}]},
{"role": "user", "content": [{"type": "text", "text": "Your prompt here"}]}
]
inputs = processor.apply_chat_template(
messages,
tokenize=True,
add_generation_prompt=True,
return_dict=True,
return_tensors="pt"
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=2048, temperature=0.7, do_sample=True)
print(processor.decode(outputs[0], skip_special_tokens=False))
The model was abliterated using PRISM - a state-of-the-art abliteration methodology combining multiple principled techniques for effective refusal removal while preserving model capabilities.
| Quantization | Min RAM/VRAM | Recommended | Hardware Examples |
|---|---|---|---|
| IQ4_XS | T GB | 12+ GB | RTX 3060 12GB, RTX 4070, Apple M1/M2/M3/M4 |
| Hardware | RAM/VRAM | Status |
|---|---|---|
| NVIDIA RTX GPU | 12+ GB | Works |
| Apple Silicon | 16+ GB Unified | Works |
Note: This is a relatively lightweight model that can run on consumer hardware with 12GB+ or less VRAM.
GLM-4.6V-Flash supports multimodal inputs:
<|begin_of_image|><|image|><|end_of_image|> tags<|begin_of_video|><|video|><|end_of_video|> tagsExample with image:
messages = [
{
"role": "user",
"content": [
{"type": "image", "image": "path/to/image.jpg"},
{"type": "text", "text": "What is in this image?"}
]
}
]
This model has been modified to reduce safety guardrails. Users are responsible for:
Apache 2.0 (same as base model zai-org/GLM-4.6V-Flash)
@misc{elbaz2025glm46vprism,
author = {Elbaz, Eric},
title = {Elbaz-GLM-4.6V-Flash-PRISM: An Abliterated GLM-4.6V Vision-Language Model},
year = {2025},
publisher = {Hugging Face},
howpublished = {\url{https://huggingface.co/Ex0bit/Elbaz-GLM-4.6V-Flash-PRISM}}
}
Created by: Ex0bit (Eric Elbaz)