Downloads · 30 days
18
17% of all-time downloads
MuXodious/Goetia-24B-v1.2-absolute-heresy
Goetia-24B-v1.2-absolute-heresy is a text generation model from MuXodious. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a Goetia-24B-v1.2 fine-tune, produced through P-E-W's Heretic (v1.1.0) abliteration engine merged with the Magnitude-Preserving Orthogonal Ablation PR.
Downloads · 30 days
18
17% of all-time downloads
All-time downloads
105
Public
Parameters
23.6B
47.2 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors47.1 GB · 100%
From the Hugging Face model README
This is a Goetia-24B-v1.2 fine-tune, produced through P-E-W's Heretic (v1.1.0) abliteration engine merged with the Magnitude-Preserving Orthogonal Ablation PR.
Note: An optimal KDL/Refusal ratio was preferred (lowest option was Refusals: 2/100, KL divergence: 0.0475). Official uncensored version: Qliphoth-24B-v1.2
Heretication Results
| Score Metric | Value | Parameter | Value |
|---|---|---|---|
| Refusals | 4/100 | direction_index | 21.99 |
| KL Divergence | 0.0322 | attn.o_proj.max_weight | 0.89 |
| Initial Refusals | 95/100 | attn.o_proj.max_weight_position | 24.59 |
| attn.o_proj.min_weight | 0.85 | ||
| attn.o_proj.min_weight_distance | 15.05 | ||
| mlp.down_proj.max_weight | 1.65 | ||
| mlp.down_proj.max_weight_position | 24.01 | ||
| mlp.down_proj.min_weight | 0.24 | ||
| mlp.down_proj.min_weight_distance | 23.25 |
The Heresy Index weighs the resulting model's corruption by the process (KL Divergence) and its abolition of doctrine (Refusals) for a final verdict in classification.
| Index Entry | Classification | Analysis |
|---|---|---|
| Absolute Heresy | Less than 10/100 Refusals and 0.10 KL Divergence | |
| Tainted Heresy | Around 25-11/100 Refusals and/or -0.20-0.11 KL Divergence | |
| Impotent Heresy | Anything above 25/100 Refusals and 0.21 KL Divergence |
Note: This is an arbitrary classification inspired by Warhammer 40K, having no tangible indication towards the model's performance.
<audio controls src="https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/KcjosKamYjk9Qm18mAGQW.mpga"></audio>
<!DOCTYPE html> <style> @import url('https://fonts.googleapis.com/css2?family=Crimson+Text:ital,wght@0,400;0,700;1,400&family=Uncial+Antiqua&display=swap'); body { font-family: 'Crimson Text', serif; color: #4A3F35; /* Faded Ink Brown */ line-height: 1.6; margin: 0; padding: 0; background-color: #281E18; /* Dark Wood Desk */ } b, strong { color: #8C1C13; /* Crimson Seal */ } .grimoire-text { font-family: 'Uncial Antiqua', cursive; color: #3D352A; /* Dark Ink */ position: relative; z-index: 2; margin-left: 0.2em; text-shadow: 0 0 10px #A49687; } /* Section styling */ .section-container { background-color: rgba(245, 235, 218, 0.05); margin-bottom: 30px; position: relative; overflow: hidden; border-bottom: 1px solid rgba(140, 28, 19, 0.3); /* Faded Crimson Border */ box-shadow: 0 4px 15px rgba(0, 0, 0, 0.2); } .section-header { display: flex; align-items: center; background-color: rgba(140, 28, 19, 0.06); padding: 10px 20px; } .section-indicator { width: 8px; height: 20px; background-color: #8C1C13; margin-right: 15px; box-shadow: 0 0 8px rgba(140, 28, 19, 0.4); } .section-title { font-family: 'Uncial Antiqua', cursive; color: #4A3F35; font-size: 1.4rem; margin: 0; letter-spacing: 1px; font-weight: 400; text-transform: capitalize; } .section-content { padding: 20px; font-family: 'Crimson Text', serif; color: #4A3F35; line-height: 1.7; } /* Title styling */ .title-container { background-color: transparent; position: relative; overflow: hidden; margin-bottom: 40px; border-left: 3px solid #8C1C13; box-shadow: 0 6px 20px rgba(0, 0, 0, 0.2); } .title-wrapper { position: relative; z-index: 2; padding: 25px 20px 30px 30px; } .title-main { color: #3D352A; font-size: 1.8rem; font-weight: 700; margin: 0; letter-spacing: 2px; display: inline-block; position: relative; text-transform: uppercase; } /* Subheading styling */ .subheading { font-family: 'Uncial Antiqua', cursive; color: #7B5E4A; /* Lighter Ink Brown */ font-size: 1.1rem; margin-top: 20px; margin-bottom: 15px; font-weight: 400; border-bottom: 1px dashed rgba(123, 94, 74, 0.4); display: inline-block; text-transform: uppercase; letter-spacing: 1px; } /* Links */ a { color: #7B5E4A; text-decoration: none; font-weight: bold; } a:hover { text-decoration: underline; color: #8C1C13; /* Crimson Seal on hover */ } /* List Styling - Goetia Icons */ ul { list-style: none; /* CRITICAL: This hides the default marker causing the blue box */ padding-left: 1.6em; } ul li { position: relative; margin-bottom: 0.6em; } ul li::before { content: "\26E7"; /* ⛧ Inverted Pentagram */ /* FALLBACK PROTECTION: */ /* This ensures that if your main font lacks the symbol, it grabs it from the system/OS symbols */ font-family: "Segoe UI Symbol", "Apple Symbols", "Noto Sans Symbols", "DejaVu Sans", sans-serif; position: absolute; left: -1.4em; /* Fiery Styling */ color: #CC0000; /* Strong red base */ font-size: 1.5rem; /* Larger */ font-weight: normal; /* Icons often render cleaner without 'bold' at this size */ top: -5px; /* Vertical alignment fix */ /* Static Fire Glow (No Animation/Low CPU cost) */ /* Layer 1: Slight dark drop shadow for depth */ /* Layer 2: Orange-red ambient glow */ text-shadow: 1px 1px 1px rgba(0,0,0,0.4), 0 0 5px #FF5500; background-color: transparent; } /* Container */ .container { max-width: 1200px; margin: 20px auto; padding: 40px 20px; background-color: #F5EBDA; /* Aged Parchment */ background-image: radial-gradient(circle at 10% 10%, rgba(140, 28, 19, 0.04) 0%, transparent 50%), radial-gradient(circle at 90% 80%, rgba(61, 53, 42, 0.06) 0%, transparent 50%); min-height: calc(100vh - 40px); border: 1px solid #C8BBAA; /* Parchment Edge */ border-radius: 3px; box-shadow: 0 8px 32px rgba(0, 0, 0, 0.3); } </style> <html lang="en"> <head> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <title>Goetia 24B v1.2</title> </head> <body> <div class="container"> <div class="title-container"> <div class="title-wrapper"> <h1 class="title-main"> <span class="grimoire-text">📜 Goetia 24B v1.2</span> </h1> </div> </div> <img src="https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/DHbuh4efzjCGpxDUciZ_-.jpeg" alt="Goetia Grimoire" style="width:100%; border-radius: 3px; margin-bottom: 30px; border: 1px solid #C8BBAA;"> <div class="section-container"> <div class="section-header"> <div class="section-indicator"></div> <h2 class="section-title">🐙 The Lesser Key</h2> </div> <div class="section-content"><font face="verdana">[!CAUTION] <span style="color:red; font-weight:bold">⚠️ Warning:</span> This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use Mistral Tekken chat template.
This is a merge of pre-trained language models created using mergekit. This model was merged using the Karcher merge method.
<b>Goetia version 1.2</b> (Checkpoint S) represents a major upgrade over v1.1. Eighteen models were combined for this behemoth merge. The following changes were made to the Goetic pipeline:<br>
<ul><li>No merges were used as donors. Finetunes only, as with the <a href="https://huggingface.co/Naphula-Archives/Cthulhu-Yamls-All-Versions">original Cthulhu</a>. This offers the least amount of vector distortion and highest accuracy for the PCA manifold. The <a href="https://huggingface.co/spaces/Naphula/model_tools/blob/main/graph_v18.py">graph_v18.py</a> script helped tremendously to merge with a 3060 Ti.</li> <li>All 2501 finetunes were removed due to incompatibility. Only MS 2503/2506 finetunes were added. <a href="https://huggingface.co/Naphula/Boreas-24B-v1.3">Boreas</a> is basically the 'outtakes' version of Goetia, featuring Mistral 2501 finetunes.</li> <li>Custom methods like <code>flux</code> and <code>chiral_qhe</code> have been developed but are still being refined. <code>karcher</code> was chosen because it produces the most stable merge using normal methods for 10+ donors. <li>Goetia was originally intended to be the spiritual successor to the Cthulhu series, made using <a href="https://github.com/cg123/mergekit">mergekit</a>. Now however, it's considered to be a <b>checkpoint</b> for <b>Cthulhu v1.4</b>, which is planned to be a finetune of the latest Goetia 24B.</b> The goal is to uncensor it during finetuning so that ablation isn't needed, and to train it on H.P. Lovecraft datasets. See <a href="https://huggingface.co/DarkArtsForge/Avnas-7B-v1">Avnas 7B</a> for a preview of this.</li> <li>Check out <a href="https://huggingface.co/OccultAI/Soulblighter-24B-v1">Soulblighter</a> or <a href="https://huggingface.co/Naphula/StormSeeker-24B-v1">StormSeeker</a> for Goetia alternatives.</li>Due to storage limits only select GGUFs are available. IQ quants were made with illuminati_imatrix_v1.txt.
<b>Download GGUFs: <a href="https://huggingface.co/Naphula/Goetia-24B-v1.2-GGUF">Naphula/Goetia-24B-v1.2-GGUF</a></b>
| Quant | Size |
|---|---|
| IQ1_S | 5.27 GB |
| IQ2_M | 8.11 GB |
| IQ3_M | 10.7 GB |
| IQ4_XS | 12.8 GB |
| IQ4_NL | 13.5 GB |
| Q5_K_M | 16.8 GB |
| Q6_K | 19.3 GB |
| Q8_K_XL | 29.8 GB |
I recommend these pages for other quantizations:
architecture: MistralForCausalLM
merge_method: karcher
models:
# WeirdCompound, Circuitry and Rotor removed due to manifold distortion (over-triangulation)
# Dolphin Venice Edition and Broken Tutu removed due to 2501 incompatibility
# NousResearch/DeepHermes-3-Mistral-24B-Preview removed due to spamming <tool_call>
# - model: B:\hub\!models--DarkArtsForge--Morax-24B-v1 # Q0F Pass # Slerp PCA1 variance is too high for Karcher manifold
- model: B:\hub\!BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly # Q0F Pass # Lower PCA1 variance but higher PCA2 variance than MS2506 finetunes, L2 norms consistent
- model: B:\hub\!models--aixonlab--Eurydice-24b-v3.5 # Q0F Pass
- model: B:\hub\!models--allura-forge--ms32-final-TEXTONLY # Q0F Pass
# - model: B:\hub\!models--allura-forge--ms32-sft-merged # No KTO version # Q0F Pass
- model: B:\hub\!models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only
- model: B:\hub\!models--ConicCat--Mistral-Small-3.2-AntiRep-24B # Q0F Fail
# - model: B:\hub\!models--CrucibleLab--M3.2-24B-Loki-V1.3 # Q0F Pass
- model: B:\hub\!models--CrucibleLab--M3.2-24B-Loki-V2 # Q0F Pass # Louder novelty magnitude than 1.3
# - model: B:\hub\!models--Darkhn--M3.2-24B-Animus-V5.1-Pro # Q0F Pass
- model: B:\hub\!models--Darkhn--M3.2-24B-Animus-V7.1 # Q0F Pass # Louder novelty magnitude than 5.1
# - model: B:\hub\!models--Darkhn--Magistral-2509-24B-Text-Only # Scores lower at Q0B than MS2506
# - model: B:\hub\!models--Delta-Vector--Austral-24B-Winton # Q0F Fail # PCA1 variance is too high (manifold outlier)
# - model: B:\hub\!models--Delta-Vector--MS3.2-Austral-Winton # Q0F Fail
# - model: B:\hub\!models--Delta-Vector--Rei-24B-KTO # Q0F Fail
- model: B:\hub\!models--Doctor-Shotgun--MS3.2-24B-Magnum-Diamond # Q0F Pass
- model: B:\hub\!models--Gryphe--Codex-24B-Small-3.2 # Q0F Pass
# - model: B:\hub\!models--Gryphe--Pantheon-RP-1.8-24b-Small-3.1 # Q0F Fail
# - model: B:\hub\!models--LatitudeGames--Harbinger-24B # Q0F Fail
- model: B:\hub\!models--LatitudeGames--Hearthfire-24B # Q0F Pass # Elevated PCA1 and PCA2 variance
- model: B:\hub\!models--PocketDoc--Dans-PersonalityEngine-V1.3.0-24b # Q0F Fail
- model: B:\hub\!models--ReadyArt--Dark-Nexus-24B-v2.0 # Q0F Pass
- model: B:\hub\!models--ReadyArt--MS3.2-The-Omega-Directive-24B-Unslop-v2.1 # Q0F Fail
# - model: B:\hub\!models--SicariusSicariiStuff--Impish_Magic_24B\fixed # Q0F Pass # Removed due to tokenizer and lm_head incompatibility
# - model: B:\hub\!models--TheDrummer--Cydonia-24B-v4.3 # Q0F Pass # Swapping this for v4.2.0 results in vastly increased refusals
# - model: B:\hub\!models--TheDrummer--Magidonia-24B-v4.3 # Q0F Pass
- model: B:\hub\!models--TheDrummer--Cydonia-24B-v4.2.0 # Q0F Pass
# - model: B:\hub\!models--TheDrummer--Cydonia-24B-v4.1 # Q0F Fail
# - model: B:\hub\!models--TheDrummer--Cydonia-24B-v4 # Q0F Fail
- model: B:\hub\!models--TheDrummer--Precog-24B-v1 # Q0F Pass # Just as smart as Cydonia v4.3 but less censored
# - model: B:\hub\!models--TheDrummer--Rivermind-24B-v1 # Q0F Pass
- model: B:\hub\!models--trashpanda-org--MS3.2-24B-Mullein-v2 # Q0F Fail (but still impressive)
# - model: B:\hub\!models--zerofata--MS3.2-PaintedFantasy-24B # Q0F Fail
- model: B:\hub\!models--zerofata--MS3.2-PaintedFantasy-v2-24B # Q0F Pass
- model: B:\hub\!models--zerofata--MS3.2-PaintedFantasy-v3-24B # Q0F Fail
dtype: bfloat16 # normally would be float32, but for this particular 18-set combo bfloat16 helps uncensor it
out_dtype: bloat16 # even more strange is that nulling out dtype and out_dtype is still as uncensored but less smart than both at bfloat16
parameters:
tokenizer:
source: union
chat_template: auto
name: Goetia-24B-v1.2
# --- OUTLIER ANALYSIS --- `audit_karcher_v2.py`
# [OUTLIER] !models--DarkArtsForge--Morax-24B-v1 | Dist: 42.5302 | Norm: 33.1133 | Size: 83886080
# [OK] !BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly | Dist: 3.6364 | Norm: 33.9199 | Size: 83886080
# [OK] !models--aixonlab--Eurydice-24b-v3.5 | Dist: 3.5703 | Norm: 33.9450 | Size: 83886080
# [OK] !models--allura-forge--ms32-final-TEXTONLY | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--allura-forge--ms32-sft-merged | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--ConicCat--Mistral-Small-3.2-AntiRep-24B | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--CrucibleLab--M3.2-24B-Loki-V1.3 | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--CrucibleLab--M3.2-24B-Loki-V2 | Dist: 2.9845 | Norm: 33.5444 | Size: 83886080
# [OK] !models--Darkhn--M3.2-24B-Animus-V5.1-Pro | Dist: 2.9710 | Norm: 33.4006 | Size: 83886080
# [OK] !models--Darkhn--M3.2-24B-Animus-V7.1 | Dist: 2.9715 | Norm: 33.4072 | Size: 83886080
# [OUTLIER] !models--Delta-Vector--Austral-24B-Winton | Dist: 43.1327 | Norm: 33.9546 | Size: 83886080
# [OK] !models--Delta-Vector--MS3.2-Austral-Winton | Dist: 2.8134 | Norm: 33.4469 | Size: 83886080
# [OK] !models--Delta-Vector--Rei-24B-KTO | Dist: 2.9708 | Norm: 33.3995 | Size: 83886080
# [OK] !models--Doctor-Shotgun--MS3.2-24B-Magnum-Diamond | Dist: 2.8897 | Norm: 33.4906 | Size: 83886080
# [OK] !models--Gryphe--Codex-24B-Small-3.2 | Dist: 2.8134 | Norm: 33.4469 | Size: 83886080
# [OK] !models--Gryphe--Pantheon-RP-1.8-24b-Small-3.1 | Dist: 3.5656 | Norm: 33.9456 | Size: 83886080
# [OK] !models--LatitudeGames--Harbinger-24B | Dist: 3.5357 | Norm: 33.9544 | Size: 83886080
# [OK] !models--LatitudeGames--Hearthfire-24B | Dist: 2.9205 | Norm: 33.4135 | Size: 83886080
# [OK] !models--PocketDoc--Dans-PersonalityEngine-V1.3.0-24b | Dist: 4.1727 | Norm: 34.3632 | Size: 83886080
# [OK] !models--ReadyArt--Dark-Nexus-24B-v2.0 | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--ReadyArt--MS3.2-The-Omega-Directive-24B-Unslop-v2.1 | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] impish magic fixed | Dist: 3.2572 | Norm: 32.2877 | Size: 83886080
# [OK] !models--TheDrummer--Cydonia-24B-v4.3 | Dist: 2.9062 | Norm: 33.4101 | Size: 83886080
# [OK] !models--TheDrummer--Magidonia-24B-v4.3 | Dist: 4.0489 | Norm: 32.3734 | Size: 83886080
# [OK] !models--TheDrummer--Cydonia-24B-v4.2.0 | Dist: 2.9723 | Norm: 33.4174 | Size: 83886080
# [OK] !models--TheDrummer--Precog-24B-v1 | Dist: 3.7905 | Norm: 32.3252 | Size: 83886080
# [OK] !models--TheDrummer--Rivermind-24B-v1 | Dist: 2.9277 | Norm: 33.3765 | Size: 83886080
# [OK] !models--trashpanda-org--MS3.2-24B-Mullein-v2 | Dist: 2.9708 | Norm: 33.3997 | Size: 83886080
# [OK] !models--zerofata--MS3.2-PaintedFantasy-24B | Dist: 2.9708 | Norm: 33.3995 | Size: 83886080
# [OK] !models--zerofata--MS3.2-PaintedFantasy-v2-24B | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--zerofata--MS3.2-PaintedFantasy-v3-24B | Dist: 4.0706 | Norm: 32.4415 | Size: 83886080
</font></div>
</div><img src="https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/nSuSM6v_BQBP4tAWK9rGQ.png"></img> <img src="https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/FOij6TMejipIERSHPtKQg.jpeg"></img>
<div class="section-container"> <div class="section-header"> <div class="section-indicator"></div> <h2 class="section-title">🕯️ Summon the Infernal — Invocation Ritual</h2> </div> <div class="section-content"><font face="verdana">Ban em dashes and ellipses (or set to -50 logit bias) to reduce slop:
—||$||...||$||…
Experiment with these settings:
(bolded kobold non-defaults)
<img src="https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/lbykxb0DJYp4kAMwCsGDu.jpeg"></img>
</html>