Downloads · 30 days
23
27% of all-time downloads
Muse-Glimmer-30B-heretic-exl3
genevera/Muse-Glimmer-30B-heretic-exl3
Muse-Glimmer-30B-heretic-exl3 is a image-text-to-text model from genevera. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
EXL3 quantized build of coder3101/Muse-Glimmer-30B-heretic, an ARA-abliterated (uncensored) version of meta-models/Muse-Glimmer-30B, converted with exllamav3 v1.4.2.
All-time downloads
84
Public
Parameters
13.2B
26.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors26.4 GB · 100%
Parameter types
How the weights are stored.
I169.9B · 75%
Try a prompt
Base models
Model card
From the Hugging Face model README
Muse-Glimmer-30B-heretic EXL3 (6.0 bpw)
EXL3 quantized build of coder3101/Muse-Glimmer-30B-heretic, an ARA-abliterated (uncensored) version of meta-models/Muse-Glimmer-30B, converted with exllamav3 v1.4.2.
Model details
| Parameter | Value |
|---|---|
| Architecture | MuseGlimmerForConditionalGeneration |
| Model type | muse_glimmer (VLM — image-text-to-text) |
| Hidden layers | 52 (39 sliding-attention + 13 full-attention, interleaved every 4th layer) |
| Hidden size | 6656 |
| KV heads | 2 (GQA) |
| Head dim | 128 |
| Vocab size | 202,048 |
| Context (native) | 131,072 tokens |
| Sliding window | 2,048 |
Quantization details
| Parameter | Value |
|---|---|
| Quant method | exl3 |
| exllamav3 version | 1.4.2 |
| Decoder bits per weight | 6.0 |
| Head bits per weight | 6.0 |
| Codebook | mul1 |
| Calibration rows | 250 |
| Calibration seq length | 2048 |
| Output scales | always |
| Shards | 4 |
| Total size | ~24.6 GB |
Usage — TabbyAPI
hf download genevera/Muse-Glimmer-30B-heretic-exl3 --local-dir models/Muse-Glimmer-30B-heretic-exl3
# config.yml
model:
model_name: Muse-Glimmer-30B-heretic-exl3
max_seq_len: 131072
cache_mode: 8,8
vision: true
reasoning: true
Multimodal (image) input
The model supports image input via the OAI chat completions API with image_url content blocks:
{
"messages": [{
"role": "user",
"content": [
{"type": "image_url", "image_url": {"url": "data:image/png;base64,..."}},
{"type": "text", "text": "Describe this image."}
]
}]
}
Speculative decoding
Pair with turboderp/Muse-Glimmer-30B-assistant-exl3 (DFlash draft model) for 2-3× speedup:
draft_model:
draft_mode: model
draft_model_name: Muse-Glimmer-30B-assistant-exl3-6.0bpw
Heretic abliteration
This model is a decensored version of meta-models/Muse-Glimmer-30B, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method (with row-norm preservation).
| Parameter | Value |
|---|---|
| start_layer_index | 10 |
| end_layer_index | 50 |
| preserve_good_behavior_weight | 0.5826 |
| steer_bad_behavior_weight | 0.0008 |
| overcorrect_relative_weight | 0.9762 |
| neighbor_count | 5 |
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- muse_glimmer
- License
- apache-2.0
- Created
- Aug 12, 2026
- Updated
- Aug 12, 2026