Magistry-24B-v1.0

<span style="color: #C9A84C; text-align: center; display: block; font-size: 2.5rem; margin-bottom: 0.3em; text-shadow: 0 0 10px rgba(201, 168, 76, 0.3);">Magistry-24B-v1.0</span>

<p style="text-align: center; color: #A89870; letter-spacing: 0.2em; text-transform: uppercase; font-size: 0.85rem; margin-top: 0; margin-bottom: 1.5em;">A Royal Merge &nbsp;·&nbsp; 24B &nbsp;·&nbsp; Apache 2.0</p> <div style="background: linear-gradient(to bottom, rgba(201, 168, 76, 0.07), rgba(26, 22, 16, 0.9)); border: 1px solid rgba(201, 168, 76, 0.35); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 5px; background: linear-gradient(90deg, #A07830, #C9A84C, #E8C96A, #C9A84C, #A07830); opacity: 0.9;"></div> <img src="https://i.imgur.com/q3KTR0b.png" alt="StrawberryLemonade" style="width: 80%; min-width: 400px; display: block; margin: auto; border-radius: 8px; margin-bottom: 1.5em;"> <p style="color: #D4C9A8; margin-bottom: 1em;">After a recent hiatus, I felt inspired to contribute to the local LLM roleplaying community again. The recent Mistral Small 24B roleplaying finetunes and merges showed real promise, punching well above their weight class, so I decided to try merging together two personal favorites: <a href="https://huggingface.co/Casual-Autopsy/Maginum-Cydoms-24B" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">Casual-Autopsy/Maginum-Cydoms-24B</a> and <a href="https://huggingface.co/DarkArtsForge/Magistaroth-24B-v1" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">DarkArtsForge/Magistaroth-24B-v1</a>, which are themselves mega merges, using <a href="https://huggingface.co/Darkhn/Magistral-2509-24B-Text-Only" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">Darkhn/Magistral-2509-24B-Text-Only</a> as a base. My goal was to see if I could retain the creativity of the source models but juice the intelligence.</p> <p style="color: #D4C9A8; margin-bottom: 0;">Something interesting happened with this blend that felt like a win to me. It came out wonderfully creative, retains good prose versatility (serious vs. wild n' spicy), and took on a distinctive, "smarter" writing style that some may prefer to its parents' style — especially if you're working on serious creative writing projects.</p> </div>

<span style="color: #C9A84C; font-size: 1.8rem; border-bottom: 1px solid rgba(201, 168, 76, 0.3); padding-bottom: 0.3em; display: block;">Known Issues</span>

<div style="background-color: #1E1A10; border: 1px solid rgba(201, 168, 76, 0.3); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #A07830, #C9A84C, #E8C96A, #C9A84C, #A07830); opacity: 0.7;"></div> <p style="color: #D4C9A8; margin-bottom: 0;">Generally speaking, this model came out good, but it will occasionally struggle with small details of logical/physical continuity — which is probably inescapable for a 24B model. Rerolling the output might fix it, or you might have to help it out by providing more explicit instructions or details so it doesn't get so confused.</p> </div>

<span style="color: #C9A84C; font-size: 1.8rem; border-bottom: 1px solid rgba(201, 168, 76, 0.3); padding-bottom: 0.3em; display: block;">Sampler Tips</span>

<div style="background-color: #1E1A10; border: 1px solid rgba(201, 168, 76, 0.3); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #A07830, #C9A84C, #E8C96A, #C9A84C, #A07830); opacity: 0.7;"></div> <p style="color: #D4C9A8; margin-bottom: 1em;">You can import the JSON below directly into SillyTavern or use the master import JSON in this repo (Magistry_SillyTavern_Master_Import.json). I recommend using these values as a <strong style="color: #E8C96A;">starting point</strong> for your own experiments. It's not like the model falls apart if you deviate from these settings, but they should be a reliable starting point for most creative tasks.</p> <h3 style="color: #EDE8DC; font-size: 1.2rem; margin-top: 1.5em; margin-bottom: 0.8em;">Key Settings at a Glance</h3> <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(130px, 1fr)); gap: 0.8rem; margin-bottom: 1.5em;"> <div style="background: rgba(201, 168, 76, 0.07); border: 1px solid rgba(201, 168, 76, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #C9A84C; margin-bottom: 0.25rem;">Temp</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #F5F0E8; font-family: 'Courier New', monospace;">0.7</span> </div> <div style="background: rgba(201, 168, 76, 0.07); border: 1px solid rgba(201, 168, 76, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #C9A84C; margin-bottom: 0.25rem;">Min-P</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #F5F0E8; font-family: 'Courier New', monospace;">0.05</span> </div> <div style="background: rgba(201, 168, 76, 0.07); border: 1px solid rgba(201, 168, 76, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #C9A84C; margin-bottom: 0.25rem;">Top-N σ</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #F5F0E8; font-family: 'Courier New', monospace;">0.75</span> </div> <div style="background: rgba(201, 168, 76, 0.07); border: 1px solid rgba(201, 168, 76, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #C9A84C; margin-bottom: 0.25rem;">DRY Mult.</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #F5F0E8; font-family: 'Courier New', monospace;">0.8</span> </div> <div style="background: rgba(201, 168, 76, 0.07); border: 1px solid rgba(201, 168, 76, 0.35); border-radius: 5px; padding: 0.7rem 1rem; text-align: center;"> <span style="display: block; font-size: 0.7rem; text-transform: uppercase; letter-spacing: 0.12em; color: #C9A84C; margin-bottom: 0.25rem;">DRY Base</span> <span style="display: block; font-size: 1.05rem; font-weight: 700; color: #F5F0E8; font-family: 'Courier New', monospace;">1.8</span> </div> </div> <details style="margin-bottom: 0; background-color: #111009; border-radius: 8px; overflow: hidden; border: 1px solid rgba(201, 168, 76, 0.25);"> <summary style="padding: 12px 15px; cursor: pointer; background-color: #1E1A10; border-bottom: 1px solid rgba(201, 168, 76, 0.25); font-weight: 600; color: #C9A84C; display: flex; align-items: center;">Full SillyTavern JSON</summary> <div style="padding: 15px;"> <pre style="background-color: rgba(0, 0, 0, 0.3); border-radius: 6px; padding: 15px; overflow-x: auto; border: 1px solid rgba(201, 168, 76, 0.2); margin: 0;"><code style="font-family: 'Courier New', Courier, monospace; font-size: 0.85em; color: #c8bfa0;">{ "temp": 0.7, "temperature_last": true, "top_p": 1, "top_k": 0, "top_a": 0, "tfs": 1, "epsilon_cutoff": 0, "eta_cutoff": 0, "typical_p": 1, "min_p": 0.05, "rep_pen": 1, "rep_pen_range": 4096, "rep_pen_decay": 0, "rep_pen_slope": 1, "no_repeat_ngram_size": 0, "penalty_alpha": 0, "num_beams": 1, "length_penalty": 1, "min_length": 0, "encoder_rep_pen": 1, "freq_pen": 0, "presence_pen": 0, "skew": 0, "do_sample": true, "early_stopping": false, "dynatemp": false, "min_temp": 0.5, "max_temp": 1, "dynatemp_exponent": 1, "smoothing_factor": 0, "smoothing_curve": 1, "dry_allowed_length": 4, "dry_multiplier": 0.8, "dry_base": 1.8, "dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \",\"]", "dry_penalty_last_n": 0, "add_bos_token": true, "ban_eos_token": false, "skip_special_tokens": false, "mirostat_mode": 0, "mirostat_tau": 2, "mirostat_eta": 0.1, "guidance_scale": 1, "negative_prompt": "", "grammar_string": "", "json_schema": null, "json_schema_allow_empty": false, "banned_tokens": "", "sampler_priority": [ "repetition_penalty", "frequency_penalty", "encoder_repetition_penalty", "dry", "presence_penalty", "top_k", "top_p", "top_n_sigma", "typical_p", "epsilon_cutoff", "eta_cutoff", "tfs", "top_a", "min_p", "quadratic_sampling", "mirostat", "dynamic_temperature", "temperature", "xtc", "no_repeat_ngram" ], "samplers": [ "penalties", "dry", "top_n_sigma", "top_k", "typ_p", "tfs_z", "typical_p", "top_p", "min_p", "adaptive_p", "xtc", "temperature" ], "samplers_priorities": [ "dry", "penalties", "no_repeat_ngram", "temperature", "top_nsigma", "top_p_top_k", "top_a", "min_p", "tfs", "eta_cutoff", "epsilon_cutoff", "typical_p", "quadratic", "xtc" ], "ignore_eos_token": false, "spaces_between_special_tokens": true, "speculative_ngram": false, "sampler_order": [6, 0, 1, 3, 4, 2, 5], "logit_bias": [], "xtc_threshold": 0.1, "xtc_probability": 0, "nsigma": 0.75, "min_keep": 0, "extensions": {}, "adaptive_target": -0.01, "adaptive_decay": 0.9, "ignore_eos_token_aphrodite": false, "spaces_between_special_tokens_aphrodite": true, "rep_pen_size": 0, "genamt": 1100, "max_length": 131072 }</code></pre> </div> </details> </div>

<span style="color: #C9A84C; font-size: 1.8rem; border-bottom: 1px solid rgba(201, 168, 76, 0.3); padding-bottom: 0.3em; display: block;">Prompting Tips</span>

<div style="background-color: #1E1A10; border: 1px solid rgba(201, 168, 76, 0.3); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #A07830, #C9A84C, #E8C96A, #C9A84C, #A07830); opacity: 0.7;"></div> <p style="color: #D4C9A8; margin-bottom: 0;">You can download the <code style="background-color: rgba(201, 168, 76, 0.1); border-radius: 3px; padding: 0.1em 0.35em; color: #E8C96A; font-family: 'Courier New', monospace;">Magistry_SillyTavern_Master_Import.json</code> file from this repo and import it directly into SillyTavern to get system prompt, chat template, and sampler settings all in one go.</p> </div>

<span style="color: #C9A84C; font-size: 1.8rem; border-bottom: 1px solid rgba(201, 168, 76, 0.3); padding-bottom: 0.3em; display: block;">Donations</span>

<div style="display: flex; align-items: center; justify-content: center; flex-direction: column; gap: 10px; padding: 20px; background: linear-gradient(to bottom, rgba(201, 168, 76, 0.07), rgba(26, 22, 16, 0.9)); border-radius: 8px; border: 1px solid rgba(201, 168, 76, 0.35); margin-top: 10px; margin-bottom: 30px;"> <a href="https://ko-fi.com/sophosympatheia"> <img src="https://i.imgur.com/LySwHVd.png" alt="Donations" style="max-width: 200px; width: 100%;"> </a> <p style="color: #D4C9A8; margin-bottom: 0.5em; text-align: center;">If you feel like saying thanks with a donation, <a href="https://ko-fi.com/sophosympatheia" style="display: inline-block; background: linear-gradient(45deg, #A07830, #C9A84C, #E8C96A); color: #1A1610; padding: 10px 20px; border-radius: 6px; font-weight: 700; letter-spacing: 0.5px; border: none; box-shadow: 0 4px 15px rgba(201, 168, 76, 0.3); text-decoration: none !important;">I'm on Ko-Fi</a></p> </div>

<span style="color: #C9A84C; font-size: 1.8rem; border-bottom: 1px solid rgba(201, 168, 76, 0.3); padding-bottom: 0.3em; display: block;">Quantizations</span>

<div style="background-color: #1E1A10; border: 1px solid rgba(201, 168, 76, 0.3); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #A07830, #C9A84C, #E8C96A, #C9A84C, #A07830); opacity: 0.7;"></div> <p style="color: #A89870; font-style: italic; margin-bottom: 0;">Please see the sidebar of the model card where a link to quantizations can be found, or <a href="https://huggingface.co/models?other=base_model:quantized:sophosympatheia/Magistry-24B-v1.0">click here for the list of them</a>.</p> </div>

<span style="color: #C9A84C; font-size: 1.8rem; border-bottom: 1px solid rgba(201, 168, 76, 0.3); padding-bottom: 0.3em; display: block;">License</span>

<div style="background-color: #1E1A10; border: 1px solid rgba(201, 168, 76, 0.3); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #A07830, #C9A84C, #E8C96A, #C9A84C, #A07830); opacity: 0.7;"></div> <p style="color: #D4C9A8; margin-bottom: 0;">Apache 2.0, inherited down from Magistral.</p> </div>

<span style="color: #C9A84C; font-size: 1.8rem; border-bottom: 1px solid rgba(201, 168, 76, 0.3); padding-bottom: 0.3em; display: block;">Merge Details</span>

<div style="background-color: #1E1A10; border: 1px solid rgba(201, 168, 76, 0.3); border-radius: 8px; padding: 25px; margin-bottom: 30px; position: relative; overflow: hidden; box-shadow: 0 4px 20px rgba(0, 0, 0, 0.5);"> <div style="position: absolute; top: 0; left: 0; width: 100%; height: 4px; background: linear-gradient(90deg, #A07830, #C9A84C, #E8C96A, #C9A84C, #A07830); opacity: 0.7;"></div> <p style="color: #D4C9A8; margin-bottom: 1em;">This is a merge of pre-trained language models created using <a href="https://github.com/cg123/mergekit" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">mergekit</a>.</p> <h3 style="color: #EDE8DC; font-size: 1.2rem; margin-top: 0.5em; margin-bottom: 0.5em;">Merge Method</h3> <p style="color: #D4C9A8; margin-bottom: 1em;">This model was merged using the <a href="https://arxiv.org/abs/2406.11617" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">DELLA</a> merge method, using <a href="https://huggingface.co/Darkhn/Magistral-2509-24B-Text-Only" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">Darkhn/Magistral-2509-24B-Text-Only</a> as a base.</p> <h3 style="color: #EDE8DC; font-size: 1.2rem; margin-top: 1.5em; margin-bottom: 0.5em;">Models Merged</h3> <p style="color: #D4C9A8; margin-bottom: 0.5em;">The following models were included in the merge:</p> <ul style="color: #D4C9A8; margin-bottom: 1em; padding-left: 20px;"> <li style="margin-bottom: 0.5em;"><a href="https://huggingface.co/Casual-Autopsy/Maginum-Cydoms-24B" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">Casual-Autopsy/Maginum-Cydoms-24B</a></li> <li style="margin-bottom: 0.5em;"><a href="https://huggingface.co/DarkArtsForge/Magistaroth-24B-v1" style="color: #C9A84C; text-decoration: none; border-bottom: 1px dotted rgba(201, 168, 76, 0.4);">DarkArtsForge/Magistaroth-24B-v1</a></li> </ul> <details style="margin-bottom: 0; background-color: #111009; border-radius: 8px; overflow: hidden; border: 1px solid rgba(201, 168, 76, 0.25);"> <summary style="padding: 12px 15px; cursor: pointer; background-color: #1E1A10; border-bottom: 1px solid rgba(201, 168, 76, 0.25); font-weight: 600; color: #C9A84C; display: flex; align-items: center;">Configuration YAML</summary> <div style="padding: 15px;"> <pre style="background-color: rgba(0, 0, 0, 0.3); border-radius: 6px; padding: 15px; overflow-x: auto; border: 1px solid rgba(201, 168, 76, 0.2); margin: 0;"><code style="font-family: 'Courier New', Courier, monospace; font-size: 0.85em; color: #c8bfa0;">models: - model: Darkhn/Magistral-2509-24B-Text-Only - model: Casual-Autopsy/Maginum-Cydoms-24B parameters: weight: 0.8 density: 0.9 epsilon: 0.099 - model: DarkArtsForge/Magistaroth-24B-v1 parameters: weight: 0.8 density: 0.9 epsilon: 0.099

merge_method: della base_model: Darkhn/Magistral-2509-24B-Text-Only

parameters: lambda: 1.0 normalize: false

tokenizer: source: union chat_template: auto dtype: bfloat16</code></pre> </div>

</details> </div>