Downloads · 30 days
64
8% of all-time downloads
Goetia-26B-A4B-v1.5
Naphula/Goetia-26B-A4B-v1.5
Goetia-26B-A4B-v1.5 is a image-text-to-text model from Naphula. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
[!NOTE] <span style="color:red; font-weight:bold"🛠️ Recommended Settings 1 | 🛠️ Recommended Settings 2</span <!DOCTYPE html <style @import url('https://fonts.googleapis.com/css2?family=Crimson+Text:ital,wght@0,400;0…
All-time downloads
782
Public
Parameters
26B
52 GB on disk
Likes
11
Public
Repo makeup
Click a slice to open those files.
.safetensors52 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- apache-2.0
- Model type
- gemma4
- Access
- Public
- Created
- Jul 13, 2026
- Updated
- Sep 11, 2026
- SHA
- 77e344d9
Try a prompt
Base models
- ApocalypseParty/G4-26B-SFT-6
- AuriAetherwiing/G4-26B-A4B-Musica-v1
- ayagaya/gem4_26B_adapter
- Calplus/GemmaWiki-Gemma-4-26b-a4b
- Darkhn/Gemma-4-26B-A4B-Animus-V14.1-FFT
- el4/Xenon-26B-A4B
- electroglyph/gemma4-26b-fiction-bf16
- google/gemma-4-26B-A4B-it
- Gryphe/Gemma-4-26B-A4B-StyleTune-V2
- Gryphe/Pantheon-Reasoning-26B-A4B-1.1
- haster/Gemma-4-26BA4B-Sonnet-3.7-Distilled-v2
- hotdogs/gemma4-26b-claude-opus-reasoning
- Jackrong/Gemopus-4-26B-A4B-it
- khazic/gemma4-26b-a4b-sft-v5
- Locutusque/Esmeralda-Gemma4-26B-A4B
- nbeerbower/Gemma4-Gutenberg-26B-A4B
- ReadyArt/Dark-Scarlett-v1.0-26B-A4B
- ReadyArt/For-Her-Darkside-26B-A4B-v1.4
- ReadyArt/Heimdallr-26B-A4B-v0.35-GGUF
- ReadyArt/Melody1437-26B-A4B-v2.0
- ReadyArt/Omega-Evolution-26B-A4B-v3.0-GGUF
- ReadyArt/Serenity-26B-A4B
- SubMaroon/Dark-Goetia-26B-A4B-LoRA-v4
- TeichAI/gemma-4-26B-A4B-it-Claude-Opus-Distill-v2
- TheDrummer/Orion-26B-A4B-v1
- UncannyEcho/Aura-Gaiden-Medium-v1.1-BF16
- zerofata/G4-MeroMero-26B-A4B
- nbeerbower/Gemma4-Gutenberg-26B-A4B-lora
Model card
From the Hugging Face model README
<!DOCTYPE html> <style> @import url('https://fonts.googleapis.com/css2?family=Crimson+Text:ital,wght@0,400;0,700;1,400&family=Uncial+Antiqua&display=swap'); body { font-family: 'Crimson Text', serif; color: #4A3F35; /* Faded Ink Brown */ line-height: 1.6; margin: 0; padding: 0; background-color: #281E18; /* Dark Wood Desk */ } b, strong { color: #8C1C13; /* Crimson Seal */ } .grimoire-text { font-family: 'Uncial Antiqua', cursive; color: #3D352A; /* Dark Ink */ position: relative; z-index: 2; margin-left: 0.2em; text-shadow: 0 0 10px #A49687; } /* Section styling */ .section-container { background-color: rgba(245, 235, 218, 0.05); margin-bottom: 30px; position: relative; overflow: hidden; border-bottom: 1px solid rgba(140, 28, 19, 0.3); /* Faded Crimson Border */ box-shadow: 0 4px 15px rgba(0, 0, 0, 0.2); } .section-header { display: flex; align-items: center; background-color: rgba(140, 28, 19, 0.06); padding: 10px 20px; } .section-indicator { width: 8px; height: 20px; background-color: #8C1C13; margin-right: 15px; box-shadow: 0 0 8px rgba(140, 28, 19, 0.4); } .section-title { font-family: 'Uncial Antiqua', cursive; color: #4A3F35; font-size: 1.4rem; margin: 0; letter-spacing: 1px; font-weight: 400; text-transform: capitalize; } .section-content { padding: 20px; font-family: 'Crimson Text', serif; color: #4A3F35; line-height: 1.7; } /* Title styling */ .title-container { background-color: transparent; position: relative; overflow: hidden; margin-bottom: 40px; border-left: 3px solid #8C1C13; box-shadow: 0 6px 20px rgba(0, 0, 0, 0.2); } .title-wrapper { position: relative; z-index: 2; padding: 25px 20px 30px 30px; } .title-main { color: #3D352A; font-size: 2.0rem; font-weight: 700; margin: 0; letter-spacing: 2px; display: inline-block; position: relative; text-transform: uppercase; } /* Force Table Headers to be dark */ th { color: #3D352A !important; opacity: 1 !important; } /* Force all other Markdown headers to be dark */ h1, h2, h3, h4, h5, h6, .section-title, .title-main, .subheading { color: #3D352A !important; opacity: 1 !important; } /* Force bullet points and list text to be dark */ li, li::marker { color: #3D352A !important; opacity: 1 !important; } /* Links */ a { color: #7B5E4A; text-decoration: none; font-weight: bold; } a:hover { text-decoration: underline; color: #8C1C13; /* Crimson Seal on hover */ } /* Container */ .container { max-width: 1200px; margin: 20px auto; padding: 40px 20px; background-color: #F5EBDA; /* Aged Parchment */ background-image: radial-gradient(circle at 10% 10%, rgba(140, 28, 19, 0.04) 0%, transparent 50%), radial-gradient(circle at 90% 80%, rgba(61, 53, 42, 0.06) 0%, transparent 50%); min-height: calc(100vh - 40px); border: 1px solid #C8BBAA; /* Parchment Edge */ border-radius: 3px; box-shadow: 0 8px 32px rgba(0, 0, 0, 0.3); } </style> <html lang="en"> <head> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <title>📜 Goetia 26B A4B v1.5</title> </head> <body> <div class="container"> <div class="title-container"> <div class="title-wrapper"> <h1 class="title-main"> <span class="grimoire-text">📜 Goetia 26B A4B v1.5</span> </h1> </div> </div> <img src="https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/DHbuh4efzjCGpxDUciZ_-.jpeg" alt="Goetia Grimoire" style="width:100%; border-radius: 3px; margin-bottom: 30px; border: 1px solid #C8BBAA;"> <div class="section-container"> <div class="section-header"> <div class="section-indicator"></div> <h2 class="section-title">🧙♀ The Invocation</h2> </div> <div class="section-content"><font face="verdana">[!NOTE] <span style="color:red; font-weight:bold">🛠️ Recommended Settings #1 | 🛠️ Recommended Settings #2</span>
This is a merge of pre-trained language models created using mergekit-exp.
Merge Details
Merge Method
This model was merged using the moe_della merge method using google/gemma-4-26B-A4B-it as a base.
Models Merged
The following models were included in the merge:
- ApocalypseParty/G4-26B-SFT-6
- AuriAetherwiing/G4-26B-A4B-Musica-v1
- ayagaya/gem4_26B_adapter
- Calplus/GemmaWiki-Gemma-4-26b-a4b
- Darkhn/Gemma-4-26B-A4B-Animus-V14.1-FFT
- el4/Xenon-26B-A4B
- electroglyph/gemma4-26b-fiction-bf16
- Gryphe/Pantheon-Reasoning-26B-A4B-1.1
- Gryphe/Gemma-4-26B-A4B-StyleTune-V2
- google/gemma-4-26B-A4B-it
- haster/Gemma-4-26BA4B-Sonnet-3.7-Distilled-v2
- hotdogs/gemma4-26b-claude-opus-reasoning
- Jackrong/Gemopus-4-26B-A4B-it
- khazic/gemma4-26b-a4b-sft-v5
- Locutusque/Esmeralda-Gemma4-26B-A4B
- nbeerbower/Gemma4-Gutenberg-26B-A4B
- ReadyArt/Dark-Scarlett-v1.0-26B-A4B
- ReadyArt/For-Her-Darkside-26B-A4B-v1.4
- ReadyArt/Heimdallr-26B-A4B-v0.35-GGUF
- ReadyArt/Melody1437-26B-A4B-v2.0
- ReadyArt/Omega-Evolution-26B-A4B-v3.0-GGUF
- ReadyArt/Serenity-26B-A4B
- SubMaroon/Dark-Goetia-26B-A4B-LoRA-v4
- TeichAI/gemma-4-26B-A4B-it-Claude-Opus-Distill-v2
- TheDrummer/Orion-26B-A4B-v1
- UncannyEcho/Aura-Gaiden-Medium-v1.1-BF16
- zerofata/G4-MeroMero-26B-A4B
⚙️ Configuration
architecture: Gemma4ForConditionalGeneration
base_model: B:\26B\google--gemma-4-26B-A4B-it # instruct
models:
- model: B:\26B\26B-Suite--Dark-Goetia-26B-A4B-v4
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\ApocalypseParty_G4-26B-SFT-6
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\AuriAetherwiing_G4-26B-A4B-Musica-v1
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ayagaya--gem4_26B_adapter-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\Calplus--GemmaWiki-Gemma-4-26b-a4b-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\Darkhn_Gemma-4-26B-A4B-Animus-V14.1-FFT
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\el4--Xenon-26B-A4B-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\electroglyph--gemma4-26b-fiction-bf16
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Gryphe--Pantheon-Reasoning-26B-A4B-1.1
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\haster--Gemma-4-26BA4B-Sonnet-3.7-Distilled-v2.Q8_0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\hotdogs--gemma4-26b-claude-opus-reasoning-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Jackrong--Gemopus-4-26B-A4B-it
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\khazic--gemma4-26b-a4b-sft-v5
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Locutusque--Esmeralda-Gemma4-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\nbeerbower--Gemma4-Gutenberg-26B-A4B-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Dark-Scarlett-v1.0-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--For-Her-Darkside-26B-A4B-v1.4
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Heimdallr-26B-A4B-v0.35-Q8_0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Melody1437-26B-A4B-v2.0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Omega-Evolution-26B-A4B-v3.0-Q8_0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Serenity-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\TeichAI--gemma-4-26B-A4B-it-Claude-Opus-Distill-v2
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0 # the smallest non-zero mlp distance "0.1048" gets nulled to keep mlp donor count at 20
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\TheDrummer--Orion-26B-A4B-v1 # Use this chat_template.jinja
parameters:
weight:
- filter: "lm_head"
value: 0.5
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.5
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\UncannyEcho--Aura-Gaiden-Medium-v1.1-BF16
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\zerofata_G4-MeroMero-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Gryphe--Gemma-4-26B-A4B-StyleTune-V2
parameters:
weight:
- filter: "lm_head"
value: 0.5
- filter: "attn"
value: 0.0
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.5
- value: 0.0
density: 0.9
epsilon: 0.09
merge_method: moe_della # https://github.com/EldritchLabs/mergekit-exp
parameters:
lambda: 1.0
# normalize: true # deprecated
normalize_weights: false
normalize_router: true
int8_mask: false
rescale: true
router_strategy: della # average # random_init
blend_experts: true
dtype: float32
out_dtype: bfloat16
tokenizer:
source: union
chat_template: auto
name: 📜 Goetia 26B A4B v1.5
Audit
<img src="donor_divergence_heatmap.png"></img>
<img src="donor_difference_table.png"></img>
This model is not currently uncensored. There are refusals and standard jailbreak resistance.
Advanced Jailbreaks can be used to bypass censorship. It can also be decensored using Heretic, although I have not had the time or funds to uncensor it yet.
Special Thanks
Thanks to @SubMaroon, @Vortex5, @redaihf, @Phil2Sat and others who helped with debugging and testing.
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- gemma4
- License
- apache-2.0
- Languages
- eng
- Created
- Jul 13, 2026
- Updated
- Sep 11, 2026