Downloads · 30 days
26
11% of all-time downloads
Forsaken-Void-12B
Vortex5/Forsaken-Void-12B
Forsaken-Void-12B is a text generation model from Vortex5. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
239
Public
Parameters
12.2B
24.5 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Nov 9, 2025
- Updated
- Nov 9, 2025
- SHA
- 85c7c588
Try a prompt
Base models
Model card
From the Hugging Face model README
<section class="shell void-theme">
<div class="title-frame">
<div class="title-block wide">
<h2 class="hero-title">Forsaken-Void-12B</h2>
</div>
<div class="image-slot inset">
<img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/NNxBT0nzFHs7tz5oTKqO5.png" alt="Ivory Consensus Symbol">
</div>
</div>
<div class="harmony-divider"></div>
<!-- === Overview === -->
<section class="pane blended">
<h2 class="pane-title hover-glow">Overview<span class="underline"></span></h2>
<p>
<strong>Forsaken-Void-12B</strong> merges
<a href="https://huggingface.co/Vortex5/Scarlet-Ink-12B" target="_blank">Scarlet-Ink-12B</a>,
<a href="https://huggingface.co/Vortex5/Shadow-Crystal-12B" target="_blank">Shadow-Crystal-12B</a>, and
<a href="https://huggingface.co/Retreatcost/Chrysologus-12B" target="_blank">Chrysologus-12B</a>
through <code>flow_karcher_consensus</code> method.
</p>
</section>
<section class="pane blended">
<h2 class="pane-title hover-glow">Custom Merge Method<span class="underline"></span></h2>
<details class="expando">
<summary>About</summary>
<div class="expando-body">
<h2>Flow-Karcher-Consensus</h2>
<h3>Concept</h3>
<p>
A consensus-driven, geometry-aware merge method that combines the rigor of the
Karcher mean with an adaptive tangent-space flow capturing each model’s unique traits.
It reconciles tensor shapes, computes a spherical consensus anchor, extracts
distinct tangent directions (meaningful deviations), and refines the result
via iterative Karcher updates on the unit sphere. The outcome is both
stable (geometric mean behavior) and expressive
(retains stylistic/behavioral diversity).
</p>
<h3>Use Cases</h3>
<ul>
<li>Merging several large models that differ slightly in tensor shape or scale.</li>
<li>Finding a coherent “central” model among diverse donors while keeping interesting variations.</li>
<li>Refining noisy or inconsistent merges by projecting them onto a stable geometric manifold.</li>
<li>
Producing merges that are smoother and more consistent than standard directional blends
(simple linear/SLERP-style) yet more dynamic and distinctive than a strict Karcher mean.
</li>
</ul>
<h3>Key Parameters</h3>
<ul>
<li><strong>tol</strong> (global) — Convergence tolerance for Karcher refinement. Default <code>1e-5</code>.</li>
<li><strong>max_iter</strong> (global) — Number of Karcher iterations. Default <code>6</code>.</li>
<li>
<strong>focus</strong> (global) — Strength of creative tangent-flow injection.
<code>0</code> = conservative consensus, <code>1</code> = high creativity. Default <code>0.5</code>.
</li>
<li>
<strong>temp</strong> (global) — Temperature for weighting donor deviations.
Lower emphasizes strongest unique differences; higher yields smoother blends. Default <code>0.25</code>.
</li>
<li><strong>eta</strong> (global) — Step size for each Karcher update. Default <code>1.0</code>.</li>
<li>
<strong>use_auto_focus</strong> (global) — Auto-adjusts <code>focus</code> based on donor similarity
(diverse donors → stronger flow). Default <code>True</code>.
</li>
<li>
<strong>auto_pad</strong> (global) — Zero-pads smaller tensors to match the largest shape (shape-safe). Default <code>True</code>.
</li>
<li>
<strong>skip_on_mismatch</strong> (global) — Skips tensors that can’t be padded cleanly, avoiding merge errors.
Default <code>True</code>.
</li>
</ul>
<h3>Distinctive Features</h3>
<ul>
<li><strong>Shape-safe reconciliation:</strong> Pads or skips mismatched tensors gracefully.</li>
<li><strong>Coherence-based adaptivity:</strong> Measures donor agreement and scales creative flow accordingly.</li>
<li><strong>Spherical averaging:</strong> Operates on unit-normalized directions to remove magnitude bias.</li>
<li>
<strong>Karcher refinement:</strong> Minimizes angular variance while injecting controlled, meaningful
tangent-space deviations.
</li>
</ul>
<details class="expando nested">
<summary>Show YAML</summary>
<pre>models:
- model: Vortex5/Scarlet-Ink-12B
- model: Vortex5/Shadow-Crystal-12B
- model: Retreatcost/Chrysologus-12B
merge_method: flow_karcher_consensus
dtype: bfloat16
parameters:
tol: 1e-9
max_iter: 300
focus: 0.6
temp: 0.3
eta: 0.9
use_auto_focus: true
</pre>
</details>
</div>
</details>
</section>
<!-- === Credits === -->
<section class="pane blended">
<h2 class="pane-title hover-glow">Credits<span class="underline"></span></h2>
<ul class="credits">
<li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static & imatrix quants</li>
<li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li>
<li><strong><a>Original creators and model authors</strong></a></li>
</ul>
</section>
<div class="harmony-divider"></div>
</section>
<style>
.shell.void-theme {
max-width: 1000px;
margin: 40px auto;
padding: 40px 24px;
background: radial-gradient(circle at 40% 60%, #030306 0%, #000 100%);
border: 1px solid rgba(80, 100, 150, 0.25);
border-radius: 18px;
box-shadow:
0 0 60px rgba(0, 0, 0, 0.8),
inset 0 0 60px rgba(40, 60, 120, 0.25),
0 0 0 2px rgba(120, 150, 255, 0.15);
color: #d8eaff;
font-family: "Cinzel", "Inter", serif;
overflow: hidden;
}
.title-frame {
display: flex;
flex-direction: column;
align-items: center;
gap: 26px;
position: relative;
margin-bottom: 26px;
}
.title-block.wide {
width: 100%;
padding: 24px 16px;
background: linear-gradient(180deg, rgba(15,15,25,0.96), rgba(10,10,20,0.96));
border: 1px solid rgba(160,190,255,0.22);
border-radius: 14px;
box-shadow:
0 0 44px rgba(140,160,255,0.28),
inset 0 0 34px rgba(100,130,255,0.16);
text-align: center;
position: relative;
}
.title-block.wide:hover::after {
content: "";
position: absolute;
left: 50%;
transform: translateX(-50%);
bottom: 6px;
width: 80%;
height: 14px;
border-radius: 999px;
background: radial-gradient(closest-side, rgba(185,205,255,0.55), rgba(160,120,255,0.25), rgba(0,0,0,0));
filter: blur(8px);
}
.hero-title {
margin: 0;
line-height: 1.25;
font-weight: 600;
letter-spacing: 0.05em;
text-transform: uppercase;
font-size: clamp(1.8rem, 5vw, 3rem);
background: linear-gradient(90deg, #f2f4ff 0%, #b7d3ff 45%, #c5aaff 100%);
-webkit-background-clip: text;
-webkit-text-fill-color: transparent;
text-shadow:
0 0 16px rgba(185,205,255,0.7),
0 0 32px rgba(160,120,255,0.5),
0 0 64px rgba(160,140,255,0.3);
}
.image-slot.inset {
text-align: center;
margin: 30px auto;
max-width: 85%;
border-radius: 14px;
background: #000;
}
.image-slot.inset img {
display: block;
max-width: 95%;
border-radius: 14px;
border: 2px solid #000;
box-shadow:
0 0 40px rgba(140,160,255,0.25),
inset 0 0 8px rgba(80,100,160,0.1);
object-fit: contain;
margin: 0 auto;
}
.subtitle {
text-align: center;
font-style: italic;
margin-top: 10px;
color: #a8b8e0;
}
.harmony-divider {
height: 10px;
max-width: 900px;
margin: 30px auto;
background: radial-gradient(circle, rgba(130,160,255,0.2), rgba(0,0,0,0.9));
border-radius: 50%;
box-shadow: inset 0 0 25px rgba(100,150,255,0.25);
}
.pane {
margin: 24px 0;
padding: 20px;
border-radius: 12px;
background: rgba(25,25,35,0.6);
border: 1px solid rgba(140,170,255,0.15);
color: #d8eaff;
box-shadow:
0 0 25px rgba(60,0,90,0.35),
0 0 40px rgba(80,120,255,0.15);
backdrop-filter: blur(8px);
transition: box-shadow .35s ease, transform .2s ease;
}
.pane:hover {
transform: translateY(-2px);
box-shadow:
0 0 35px rgba(120,0,180,0.6),
0 0 60px rgba(100,150,255,0.25);
}
.pane-title {
font-size: 1.4rem;
position: relative;
margin-bottom: 12px;
color: #e6e6ff;
}
.pane-title .underline {
position: absolute;
left: 0; bottom: -6px;
width: 100%; height: 2px;
border-radius: 3px;
background: linear-gradient(90deg, transparent, #500050, transparent);
opacity: .4;
transition: opacity .35s;
}
.pane-title:hover .underline { opacity: 1; }
details summary {
cursor: pointer;
font-weight: 600;
color: #c2d8ff;
margin: 10px 0;
}
.shell pre {
background: rgba(5,8,16,0.9);
color: #e7f5ff;
border-left: 3px solid rgba(120,180,255,0.5);
border-radius: 8px;
padding: 12px;
font-size: 13px;
overflow-x: auto;
box-shadow: inset 0 0 10px rgba(100,150,255,0.2);
}
.shell a {
color: #9deaff;
text-decoration: none;
transition: color .25s ease, text-shadow .25s ease;
}
.shell a:hover {
color: #ffe3a8;
text-shadow: 0 0 8px rgba(255,230,180,0.7);
}
.credits {
list-style: none;
padding-left: 0;
line-height: 1.8;
margin: 14px 0 0;
}
</style>
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Nov 9, 2025
- Updated
- Nov 9, 2025