SteelStorage_-_G2-MS-Nyxora-27b-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

G2-MS-Nyxora-27b - GGUF

• Model creator: https://huggingface.co/SteelStorage/
• Original model: https://huggingface.co/SteelStorage/G2-MS-Nyxora-27b/

Original model description:

license: apache-2.0

<!DOCTYPE html> <html lang="en"> <head> <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <title>G2-MS-Nyxora-27b Data Card</title> <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet"> <style> body, html { height: 100%; margin: 0; padding: 0; font-family: 'Quicksand', sans-serif; background: linear-gradient(135deg, #0a1128 0%, #1c2541 100%); color: #e0e1dd; font-size: 16px; } .container { width: 100%; height: 100%; padding: 20px; margin: 0; background-color: rgba(255, 255, 255, 0.05); border-radius: 12px; box-shadow: 0 4px 10px rgba(0, 0, 0, 0.3); backdrop-filter: blur(10px); border: 1px solid rgba(255, 255, 255, 0.1); } .header h1 { font-size: 28px; color: #4cc9f0; margin: 0 0 20px 0; text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3); } .update-section h2 { font-size: 24px; color: #7209b7; } .update-section p { font-size: 16px; line-height: 1.6; color: #e0e1dd; } .info img { width: 100%; border-radius: 10px; margin-bottom: 15px; } a { color: #4cc9f0; text-decoration: none; } a:hover { color: #f72585; } .button { display: inline-block; background-color: #3a0ca3; color: #e0e1dd; padding: 10px 20px; border-radius: 5px; cursor: pointer; text-decoration: none; } .button:hover { background-color: #7209b7; } pre { background-color: #1c2541; padding: 10px; border-radius: 5px; overflow-x: auto; } code { font-family: 'Courier New', monospace; color: #e0e1dd; } .donation-section { margin-top: 20px; text-align: center; } .donation-section p { margin-bottom: 10px; } </style> </head> <body> <div class="container"> <div class="header"> <h1>G2-MS-Nyxora-27b</h1> </div> <div class="info"> <img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/rqcAEjzvLpQwu2Cg3g1hH.png" alt="Model Image"> <p>Now that the cute anime girl has your attention.</p> <p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p> <h1>About G2-MS-Nyxora-27b:</h1> <pre><code><strong>Model Name Legend =</strong> "G2 = Gemma 2" "MS = Model_stock"</code></pre> <p>This model represents an experimental foray into 27b models. Feedback is welcome for further improvements.</p> <p>G2-MS-Nyxora-27b combines multiple models' strengths to provide a versatile assistant for various tasks, including general use, storytelling, and roleplay (ERP & RP). </p> <p>The Model seems to be on the prudish side from google's training but seems to be fixed with a good system prompt. (Provided in files)</p> <p>The Model_stock merge method ensures the model remains focused, tailored, and high-quality.</p> <h2>Quants:</h2> <p>Will add as found or im notified of their creation (If you know of one create a discussion!) <li><a href="https://huggingface.co/mradermacher">Mradermacher</a>, GGUF Quants</li> <li><a href="https://huggingface.co/mradermacher/G2-MS-Nyxora-27b-GGUF" target="_blank">Mradermacher/G2-MS-Nyxora-27b-GGUF</a></li> <li><a href="https://huggingface.co/mradermacher/G2-MS-Nyxora-27b-i1-GGUF" target="_blank">Mradermacher/G2-MS-Nyxora-27b-i1-GGUF</a></li> <li><a href="https://huggingface.co/SteelQuants">SteelQuants</a>, My Personal Quants</li> <li><a href="https://huggingface.co/SteelQuants/G2-MS-Nyxora-27b-Q4_K_M-GGUF"> - G2-MS-Nyxora-27b-Q4_K_M-GGUF</a></li> <li><a href="https://huggingface.co/SteelQuants/G2-MS-Nyxora-27b-Q6_K-GGUF"> - G2-MS-Nyxora-27b-Q6_K-GGUF</a></li> <p></p> <h2>Config:</h2> <pre><code>MODEL_NAME = "G2-MS-Nyxora-27b" yaml_config = """ base_model: google/gemma-2-27b-it merge_method: model_stock dtype: bfloat16 models: - model: TheDrummer/Big-Tiger-Gemma-27B-v1 - model: migtissera/Tess-v2.5-Gemma-2-27B-alpha """</code></pre> <h4>Template:</h4> <pre><code>&lt;start_of_turn&gt;user {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }}&lt;end_of_turn&gt; &lt;start_of_turn&gt;model {{ .Response }}&lt;end_of_turn&gt;</code></pre> <h4>Source Model Details:</h4> <p><strong>TheDrummer/Big-Tiger-Gemma-27B-v1:</strong><br> A decensored version of the Gemma 27B model. </p> <p><strong>migtissera/Tess-v2.5-Gemma-2-27B-alpha:</strong><br> The latest state-of-the-art model in the Tess series, Tess-v2.5.2, offers significant improvements in reasoning, coding, and mathematics. It ranks #1 on the MMLU benchmark among open weight models and outperforms several frontier closed models. </p> <p><strong>Gemma-2-27b-it:</strong><br> A lightweight, state-of-the-art model from Google, well-suited for various text generation tasks. Its small size allows deployment in resource-limited environments, fostering AI innovation for all. </p> <h4>Merge Method Details:</h4> <p>Model_stock Uses some neat geometric properties of fine tuned models to compute good weights for linear interpolation.</p> <p><strong>I've had a few people ask about donations so here's a link:</strong</p> </div> <div class="donation-section"> <a href="https://ko-fi.com/Y8Y0AO2XE" target="_blank"> <img height="36" style="border:0px;height:36px;" src="https://storage.ko-fi.com/cdn/kofi2.png?v=3" border="0" alt="Buy Me a Coffee at ko-fi.com" /> </a> </div> </div> </body> </html>