Glistening-Gem-31B-v2.1-mlx-bf16

beezu/Glistening-Gem-31B-v2.1-mlx-bf16

This model beezu/Glistening-Gem-31B-v2.1-mlx-bf16 was converted to MLX format from sophosympatheia/Glistening-Gem-31B-v2.1 using mlx-lm version 0.31.3.

Original Model Card

<span style="color: #227CAE; text-align: center; display: block; font-size: 2.5rem; margin-bottom: 0.3em; text-shadow: 0 0 10px rgba(34, 124, 174, 0.2);">Glistening-Gem-31B-v2.1</span>

<p style="text-align: center; color: #457291; letter-spacing: 0.2em; text-transform: uppercase; font-size: 0.85rem; font-weight: 600; margin-top: 0; margin-bottom: 1.5em;">A Creative Merge &nbsp;·&nbsp; 31B &nbsp;·&nbsp; Apache 2.0</p> <div style="background: linear-gradient(to bottom, rgba(91, 164, 207, 0.12), rgba(14, 20, 28, 0.95)); background-color: #0E141C; border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.3);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 5px; background: linear-gradient(90deg, #2A6B8C, #5BA4CF, #8BCAE6, #5BA4CF, #2A6B8C); opacity: 0.9;"></div> <p style="color: #B8D4E8; margin-bottom: 1em;">This is a merge of <a href="https://huggingface.co/TheDrummer/Artemis-31B-v1" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">TheDrummer/Artemis-31B-v1</a>, <a href="https://huggingface.co/zerofata/G4-MeroMero-v2-31B" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">zerofata/G4-MeroMero-v2-31B</a>, and <a href="https://huggingface.co/llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic</a> using stock <a href="https://huggingface.co/google/gemma-4-31B-it" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">google/gemma-4-31B-it</a> as a base.</p> <p style="color: #B8D4E8; margin-bottom: 1em;">This merge improves upon <a href="https://huggingface.co/sophosympatheia/Glistening-Gem-31B-v1.0" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">sophosympatheia/Glistening-Gem-31B-v1.0</a> in creativity and prose, and avoids the issues that caused v2.0 to be a failed recipe.</p> </div>

<a name="known-issues"></a>

<span style="color: #227CAE; font-size: 1.8rem; border-bottom: 1px solid rgba(34, 124, 174, 0.35); padding-bottom: 0.3em; display: block;">Known Issues</span>

<div style="background-color: #121A24; border: 1px solid rgba(91, 164, 207, 0.3); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #2A6B8C, #5BA4CF, #8BCAE6, #5BA4CF, #2A6B8C); opacity: 0.7;"></div> <p style="color: #B8D4E8; margin-bottom: 1em;">This v2.1 release fixes the issues with v2.0 by using stock Gemma 4 instead of an exotic base model that made customizations to the final output layer of Gemma 4 that do not merge cleanly with other models. However, v2.1 still <i>rarely</i> produces some artifacts in a similar manner to v1, such as occasionally fusing two words together that should be separated by a space, or misspelling a word. These artifacts are quite rare in my testing and can be made even rarer by running more conservative sampler settings, like raising Min-P.</p> <p style="color: #B8D4E8; margin-bottom: 1em;">I believe the artifacting behavior comes from llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic in the recipe, which would explain it in v1 too. That ingredient helps shake up the word choices, but it also contributes to instability. The v2.1 recipe mitigates that impact better than v1 through strategic layer management, but I haven't perfected it yet. I think you'll find this model's outputs worth the trouble of having to occasionally fix a typo.</p> </div>

<span style="color: #227CAE; font-size: 1.8rem; border-bottom: 1px solid rgba(34, 124, 174, 0.35); padding-bottom: 0.3em; display: block;">Sampler Tips</span>

<div style="background-color: #121A24; border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.3);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #2A6B8C, #5BA4CF, #8BCAE6, #5BA4CF, #2A6B8C); opacity: 0.7;"></div> <p style="color: #B8D4E8; margin-bottom: 1em;">You can use the master import JSON in this repo (Glistening-Gem-v2-ST-Import.json) to deploy the sampler settings below. I recommend using these values as a <strong style="color: #8BCAE6;">starting point</strong> for your own experiments. It's not like the model falls apart if you deviate from these settings, but they should be a reliable starting point for most creative tasks.</p> <h3 style="color: #D4E8F5; font-size: 1.2rem; margin-top: 1.5em; margin-bottom: 0.8em;">Sampler Settings</h3> <p style="color: #B8D4E8; margin-bottom: 1em;">Try these settings as a starting point.</p> <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(130px, 1fr)); gap: 0.8rem; margin-bottom: 1.5em;"> <div style="background: rgba(91, 164, 207, 0.12); border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #70B5DD; margin-bottom: 0.25rem;">Temp</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #E8F0F8; font-family: 'Courier New', monospace;">0.8</span> </div> <div style="background: rgba(91, 164, 207, 0.12); border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #70B5DD; margin-bottom: 0.25rem;">Min-P</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #E8F0F8; font-family: 'Courier New', monospace;">0.1</span> </div> <div style="background: rgba(91, 164, 207, 0.12); border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #70B5DD; margin-bottom: 0.25rem;">Adaptive-P Target</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #E8F0F8; font-family: 'Courier New', monospace;">0.6</span> </div> <div style="background: rgba(91, 164, 207, 0.12); border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #70B5DD; margin-bottom: 0.25rem;">Adaptive-P Decay</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #E8F0F8; font-family: 'Courier New', monospace;">0.75</span> </div> <div style="background: rgba(91, 164, 207, 0.12); border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #70B5DD; margin-bottom: 0.25rem;">DRY Mult.</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #E8F0F8; font-family: 'Courier New', monospace;">0.8</span> </div> <div style="background: rgba(91, 164, 207, 0.12); border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #70B5DD; margin-bottom: 0.25rem;">DRY Base</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #E8F0F8; font-family: 'Courier New', monospace;">1.8</span> </div> </div> </div>

<span style="color: #227CAE; font-size: 1.8rem; border-bottom: 1px solid rgba(34, 124, 174, 0.35); padding-bottom: 0.3em; display: block;">Prompting Tips</span>

<div style="background-color: #121A24; border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.3);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #2A6B8C, #5BA4CF, #8BCAE6, #5BA4CF, #2A6B8C); opacity: 0.7;"></div> <p style="color: #B8D4E8; margin-bottom: 0;">You can download the <code style="background-color: rgba(91, 164, 207, 0.15); border-radius: 3px; padding: 0.1em 0.35em; color: #8BCAE6; font-family: 'Courier New', monospace;">Glistening-Gem-v2-ST-Import.json</code> file from this repo and import it directly into SillyTavern to get system prompt, chat template, and sampler settings all in one go.</p> </div>

<span style="color: #227CAE; font-size: 1.8rem; border-bottom: 1px solid rgba(34, 124, 174, 0.35); padding-bottom: 0.3em; display: block;">Donations</span>

<div style="display: flex; align-items: center; justify-content: center; flex-direction: column; gap: 10px; padding: 20px; background: linear-gradient(to bottom, rgba(91, 164, 207, 0.12), rgba(14, 20, 28, 0.95)); background-color: #0E141C; border-radius: 8px; border: 1px solid rgba(91, 164, 207, 0.35); margin-top: 10px; margin-bottom: 30px;"> <a href="https://ko-fi.com/sophosympatheia"> <img src="https://i.imgur.com/LySwHVd.png" alt="Donations" style="max-width: 200px; width: 100%;"> </a> <p style="color: #B8D4E8; margin-bottom: 0.5em; text-align: center;">If you feel like saying thanks with a donation, <a href="https://ko-fi.com/sophosympatheia" style="display: inline-block; background: linear-gradient(45deg, #2A6B8C, #5BA4CF, #8BCAE6); color: #0E141C; padding: 10px 20px; border-radius: 6px; font-weight: 700; letter-spacing: 0.5px; border: none; box-shadow: 0 4px 15px rgba(91, 164, 207, 0.3); text-decoration: none !important;">I'm on Ko-Fi</a></p> </div>

<span style="color: #227CAE; font-size: 1.8rem; border-bottom: 1px solid rgba(34, 124, 174, 0.35); padding-bottom: 0.3em; display: block;">Quantizations</span>

<div style="background-color: #121A24; border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.3);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #2A6B8C, #5BA4CF, #8BCAE6, #5BA4CF, #2A6B8C); opacity: 0.7;"></div> <p style="color: #94B4CE; font-style: italic; margin-bottom: 0;">Please see the sidebar of the model card where a link to quantizations can be found, or <a href="https://huggingface.co/models?other=base_model:quantized:sophosympatheia/Glistening-Gem-31B-v2.1" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">click here for the list of them</a>.</p> </div>

<span style="color: #227CAE; font-size: 1.8rem; border-bottom: 1px solid rgba(34, 124, 174, 0.35); padding-bottom: 0.3em; display: block;">License</span>

<div style="background-color: #121A24; border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.3);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #2A6B8C, #5BA4CF, #8BCAE6, #5BA4CF, #2A6B8C); opacity: 0.7;"></div> <p style="color: #B8D4E8; margin-bottom: 0;">Apache 2.0, inherited down from Gemma.</p> </div>

<span style="color: #227CAE; font-size: 1.8rem; border-bottom: 1px solid rgba(34, 124, 174, 0.35); padding-bottom: 0.3em; display: block;">Merge Details</span>

<div style="background-color: #121A24; border: 1px solid rgba(91, 164, 207, 0.35); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.3);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #2A6B8C, #5BA4CF, #8BCAE6, #5BA4CF, #2A6B8C); opacity: 0.7;"></div> <p style="color: #B8D4E8; margin-bottom: 1em;">This is a merge of pre-trained language models created using <a href="https://github.com/cg123/mergekit" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">mergekit</a>.</p> <h3 style="color: #D4E8F5; font-size: 1.2rem; margin-top: 0.5em; margin-bottom: 0.5em;">Merge Method</h3> <p style="color: #B8D4E8; margin-bottom: 1em;">This model was merged using the <a href="https://arxiv.org/abs/2406.11617" style="color: #70B5DD; text-decoration: none; border-bottom: 1px dotted rgba(91, 164, 207, 0.5);">DELLA</a> merge method using <code style="background-color: rgba(91, 164, 207, 0.15); border-radius: 3px; padding: 0.1em 0.35em; color: #8BCAE6; font-family: 'Courier New', monospace;">densenet/Gemma-4-31B-StyleTune-heretic-ara</code> as a base.</p> <p style="color: #B8D4E8; margin-bottom: 0;">See the model intro for more details and the mergekit_config.yaml file in the repo for the full recipe.</p> </div>