Downloads ยท 30 days
185
42% of all-time downloads
Naphula/Goetia-26B-A4B-v1.6
Goetia-26B-A4B-v1.6 is a image-text-to-text model from Naphula. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
[!NOTE] <span style="color:red; font-weight:bold"๐ ๏ธ Recommended Settings 1 | ๐ ๏ธ Recommended Settings 2</span <!DOCTYPE html <style @import url('https://fonts.googleapis.com/css2?family=Crimson+Text:ital,wght@0,400;0โฆ
Downloads ยท 30 days
185
42% of all-time downloads
All-time downloads
443
Public
Parameters
26B
52 GB on disk
Likes
20
Public
Click a slice to open those files.
.safetensors52 GB ยท 100%
From the Hugging Face model README
<!DOCTYPE html> <style> @import url('https://fonts.googleapis.com/css2?family=Crimson+Text:ital,wght@0,400;0,700;1,400&family=Uncial+Antiqua&display=swap'); body { font-family: 'Crimson Text', serif; color: #4A3F35; /* Faded Ink Brown */ line-height: 1.6; margin: 0; padding: 0; background-color: #281E18; /* Dark Wood Desk */ } b, strong { color: #8C1C13; /* Crimson Seal */ } .grimoire-text { font-family: 'Uncial Antiqua', cursive; color: #3D352A; /* Dark Ink */ position: relative; z-index: 2; margin-left: 0.2em; text-shadow: 0 0 10px #A49687; } /* Section styling */ .section-container { background-color: rgba(245, 235, 218, 0.05); margin-bottom: 30px; position: relative; overflow: hidden; border-bottom: 1px solid rgba(140, 28, 19, 0.3); /* Faded Crimson Border */ box-shadow: 0 4px 15px rgba(0, 0, 0, 0.2); } .section-header { display: flex; align-items: center; background-color: rgba(140, 28, 19, 0.06); padding: 10px 20px; } .section-indicator { width: 8px; height: 20px; background-color: #8C1C13; margin-right: 15px; box-shadow: 0 0 8px rgba(140, 28, 19, 0.4); } .section-title { font-family: 'Uncial Antiqua', cursive; color: #4A3F35; font-size: 1.4rem; margin: 0; letter-spacing: 1px; font-weight: 400; text-transform: capitalize; } .section-content { padding: 20px; font-family: 'Crimson Text', serif; color: #4A3F35; line-height: 1.7; } /* Title styling */ .title-container { background-color: transparent; position: relative; overflow: hidden; margin-bottom: 40px; border-left: 3px solid #8C1C13; box-shadow: 0 6px 20px rgba(0, 0, 0, 0.2); } .title-wrapper { position: relative; z-index: 2; padding: 25px 20px 30px 30px; } .title-main { color: #3D352A; font-size: 2.0rem; font-weight: 700; margin: 0; letter-spacing: 2px; display: inline-block; position: relative; text-transform: uppercase; } /* Force Table Headers to be dark */ th { color: #3D352A !important; opacity: 1 !important; } /* Force all other Markdown headers to be dark */ h1, h2, h3, h4, h5, h6, .section-title, .title-main, .subheading { color: #3D352A !important; opacity: 1 !important; } /* Force bullet points and list text to be dark */ li, li::marker { color: #3D352A !important; opacity: 1 !important; } /* Links */ a { color: #7B5E4A; text-decoration: none; font-weight: bold; } a:hover { text-decoration: underline; color: #8C1C13; /* Crimson Seal on hover */ } /* Container */ .container { max-width: 1200px; margin: 20px auto; padding: 40px 20px; background-color: #F5EBDA; /* Aged Parchment */ background-image: radial-gradient(circle at 10% 10%, rgba(140, 28, 19, 0.04) 0%, transparent 50%), radial-gradient(circle at 90% 80%, rgba(61, 53, 42, 0.06) 0%, transparent 50%); min-height: calc(100vh - 40px); border: 1px solid #C8BBAA; /* Parchment Edge */ border-radius: 3px; box-shadow: 0 8px 32px rgba(0, 0, 0, 0.3); } </style> <html lang="en"> <head> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <title>๐ Goetia 26B A4B v1.6</title> </head> <body> <div class="container"> <div class="title-container"> <div class="title-wrapper"> <h1 class="title-main"> <span class="grimoire-text">๐ Goetia 26B A4B v1.6</span> </h1> </div> </div> <img src="https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/DHbuh4efzjCGpxDUciZ_-.jpeg" alt="Goetia Grimoire" style="width:100%; border-radius: 3px; margin-bottom: 30px; border: 1px solid #C8BBAA;"> <div class="section-container"> <div class="section-header"> <div class="section-indicator"></div> <h2 class="section-title">๐งโโ The Invocation</h2> </div> <div class="section-content"><font face="verdana">[!NOTE] <span style="color:red; font-weight:bold">๐ ๏ธ Recommended Settings #1 | ๐ ๏ธ Recommended Settings #2</span>
This is a merge of pre-trained language models created using mergekit-exp.
Compared to v1.5, this version uses newer Orion and Pantheon models, along with an upgraded lm_head. It also replaces Dark Goetia with Boulesis v1.
This model was merged using the moe_della merge method using google/gemma-4-26B-A4B-it as a base.
The following models were included in the merge:
architecture: Gemma4ForConditionalGeneration
base_model: B:\26B\google--gemma-4-26B-A4B-it # instruct
models:
- model: B:\26B\ApocalypseParty_G4-26B-SFT-6
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\AuriAetherwiing_G4-26B-A4B-Musica-v1
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ayagaya--gem4_26B_adapter-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\BeaverAI--Orion-26B-A4B-v1g-Q8_0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Calplus--GemmaWiki-Gemma-4-26b-a4b-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\Darkhn_Gemma-4-26B-A4B-Animus-V14.1-FFT
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\el4--Xenon-26B-A4B-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\electroglyph--gemma4-26b-fiction-bf16
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Gryphe--Pantheon-Reasoning-26B-A4B-1.1-V2
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\haster--Gemma-4-26BA4B-Sonnet-3.7-Distilled-v2.Q8_0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\hotdogs--gemma4-26b-claude-opus-reasoning-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Jackrong--Gemopus-4-26B-A4B-it
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\khazic--gemma4-26b-a4b-sft-v5
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Locutusque--Esmeralda-Gemma4-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\nbeerbower--Gemma4-Gutenberg-26B-A4B-safetensors
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Dark-Scarlett-v1.0-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--For-Her-Darkside-26B-A4B-v1.4
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Heimdallr-26B-A4B-v0.35-Q8_0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Melody1437-26B-A4B-v2.0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Omega-Evolution-26B-A4B-v3.0-Q8_0
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\ReadyArt--Serenity-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\SubMaroon--Boulesis-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\TeichAI--gemma-4-26B-A4B-it-Claude-Opus-Distill-v2
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0 # the smallest non-zero mlp distance "0.1048" gets nulled to keep mlp donor count at 20
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\TheDrummer--Orion-26B-A4B-v1 # Use this chat_template.jinja
parameters:
weight:
- filter: "lm_head"
value: 0.5
- filter: "attn"
value: 0.0
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.5
- value: 0.00
density: 1.0
epsilon: 0.0
- model: B:\26B\UncannyEcho--Aura-Gaiden-Medium-v1.1-BF16
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.0
- value: 0.0
density: 0.9
epsilon: 0.09
- model: B:\26B\zerofata--G4-MeroMero-26B-A4B
parameters:
weight:
- filter: "lm_head"
value: 0.0
- filter: "attn"
value: 0.04
- filter: "mlp"
value: 0.05
- filter: "embed_tokens"
value: 0.0
- value: 0.05
density: 0.9
epsilon: 0.09
- model: B:\26B\Gryphe--Gemma-4-26B-A4B-StyleTune-V2
parameters:
weight:
- filter: "lm_head"
value: 0.5
- filter: "attn"
value: 0.0
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.5
- value: 0.0
density: 1.0
epsilon: 0.0
merge_method: moe_della
parameters:
lambda: 1.0
# normalize: true # deprecated
normalize_weights: false
normalize_router: true
int8_mask: false
rescale: true
router_strategy: della # average # random_init
blend_experts: true
dtype: float32
out_dtype: bfloat16
tokenizer:
source: union
chat_template: auto
name: ๐ Goetia 26B A4B v1.6A
architecture: Gemma4ForConditionalGeneration
base_model: B:\26B\Goetia-26B-A4B-v1.6A # instruct
models:
- model: B:\26B\TheDrummer--Orion-26B-A4B-v1 # Use this chat_template.jinja
parameters:
weight:
- filter: "lm_head"
value: 0.5
- filter: "attn"
value: 0.0
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.5
- value: 0.0
density: 1.0
epsilon: 0.0
- model: B:\26B\Gryphe--Pantheon-Reasoning-26B-A4B-1.1-V2
parameters:
weight:
- filter: "lm_head"
value: 0.5
- filter: "attn"
value: 0.0
- filter: "mlp"
value: 0.0
- filter: "embed_tokens"
value: 0.5
- value: 0.0
density: 1.0
epsilon: 0.0
merge_method: moe_della # https://github.com/EldritchLabs/mergekit-exp
parameters:
lambda: 1.0
# normalize: true # deprecated
normalize_weights: false
normalize_router: true
int8_mask: false
rescale: true
router_strategy: della # average # random_init
blend_experts: true
dtype: float32
out_dtype: bfloat16
tokenizer:
source: union
chat_template: auto
name: ๐ Goetia 26B A4B v1.6
Advanced Jailbreaks can be used to bypass censorship. It can also be decensored using Heretic, although I have not had the time or funds to uncensor it yet.
Thanks to @SubMaroon, @Vortex5, @redaihf, @Phil2Sat and others who helped with debugging and testing.