Downloads · 30 days
11
23% of all-time downloads
Mawnia-12B-MLX-HI
Mawdistical/Mawnia-12B-MLX-HI
Mawnia-12B-MLX-HI is a machine learning model from Mawdistical. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as other.
MLX quants of Mawdistical/Mawnia-12B using <a href="https://github.com/ml-explore/mlx-lm"mlx-lm</a for quantization on Apple Silicon.
All-time downloads
48
Public
Parameters
11.8B
44.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors23.5 GB · 100%
At a glance
- Library
- mlx
- License
- other
- Model type
- gemma3
- Access
- Public
- Created
- Sep 22, 2025
- Updated
- Sep 23, 2025
- SHA
- c443aad4
Base models
Model card
From the Hugging Face model README
MLX Quants of Mawdistical/Mawnia-12B
MLX quants of Mawdistical/Mawnia-12B using <a href="https://github.com/ml-explore/mlx-lm">mlx-lm</a> for quantization on Apple Silicon.
Quants
Configure mlx
[uv venv] # First-time setup with uv (optional)
[uv] pip install -U mlx-lm
The uv wrapper is optional but recommended, get it with Homebrew:
brew install uv
Serve an OpenAI-compatible endpoint
[uv run] mlx-lm.server --model soundTeam/Mawnia-12B_mlx-hi_8bpw --temp 1.35 --min-p 0.07
The default URL is http://127.0.0.1:8080/v1
Programmatic usage
from mlx_lm import load, generate
model, tokenizer = load("soundTeam/Mawnia-12B-MLX_hi")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
Original model card
<!-- COLORS: --accent-red: #722F37; --accent-grey: #AAAAAA; --black: #000000; --white: #FFFFFF; --> <div style="background-color: #CCCCCC; color: #000000; padding: 28px 18px; border-radius: 10px; width: 100%; border: 1px solid #DDDDDD;"> <div align="center"> <h1 style="color: #000000; margin-bottom: 18px; font-size: 2.1em; font-family:serif;"> Mawnia-12B </h1><img src="https://cdn-uploads.huggingface.co/production/uploads/67c10cfba43d7939d60160ff/stApfQUOIW3baQcYrcOP_.png" width="680px" style="border-radius:8px; border:4px solid #000000; box-shadow:0 0 16px #CCCCCC; display:block;" alt="Model Thumbnail" />
<h3 style="color: #722F37; font-style: italic; margin-top: 13px;">Explicit Content Warning</h3> <p style="color: #000000; font-size: 1.13em; font-weight:bold; margin:13px 0 12px 0;"> <a href="https://discord.gg/aU3a5phBQD" style="color:#000000; text-decoration:underline; font-size:1.17em;"><b>Join our Discord Community →</b></a> </p> <p style="color: #000000; font-size: 0.95em; margin-bottom: 14px;"> <a href="https://ko-fi.com/mawnipulator" style="color: #000000; text-decoration: underline; font-weight:bold;">Support Mawdistical finetunes here</a> </p> </div> <div style="background-color: #CCCCCC; color: #000000; padding: 16px; border-radius: 7px; margin: 22px 0; border-left: 3px solid #722F37;"> <p style="font-style: italic;"> D1 Mawnipulatine Mansplainer Maxxing </p> </div> <hr style="border: 0; height: 1px; background-color: #DDDDDD; margin: 25px 0;"> <h2 style="color: #000000; font-size: 1.25em; border-bottom: 1px solid #DDDDDD; padding-bottom: 7px;">✧ Browse the Mawnia-12B Collection</h2> <p> <a href="https://huggingface.co/collections/Mawdistical/mawnia-12b-68ce40e2d3b0ddfce24de965" style="color: #722F37; text-decoration: underline;">All Mawnia-12B Quants</a> </p> <hr style="border: 0; height: 1px; background-color: #DDDDDD; margin: 25px 0;"> <h2 style="color: #000000; font-size: 1.25em; border-bottom: 1px solid #DDDDDD; padding-bottom: 7px;">✧ Recommended Settings</h2> <p> <strong style="color: #000000;">Temp:</strong> 1.35, <strong style="color: #000000;">min_p:</strong> 0.05<br> Experiment to find your taste. </p> <hr style="border: 0; height: 1px; background-color: #DDDDDD; margin: 25px 0;"> <h2 style="color: #000000; font-size: 1.2em; border-bottom: 1px solid #DDDDDD; padding-bottom: 7px;">✧ Finetuned Set Info</h2> <div style="margin-left: 0; font-size:1.07em; margin-bottom:18px;"> <b style="color: #722F37;">Entries</b><br> <span style="margin-left: 2em; color: #000000;">↳ 2.2K Unique Set Scenarios</span><br><b style="color: #722F37;">Entry Composition</b><br> <span style="margin-left: 2em; color: #000000;">↳ Heavy Violence</span><br> <span style="margin-left: 2em; color: #000000;">↳ Dark Themes</span><br> <span style="margin-left: 2em; color: #000000;">↳ Extensive NSFL</span><br> <span style="margin-left: 2em; color: #000000;">↳ Non-lethal but enough to scare people.</span><br> <span style="margin-left: 2em; color: #000000;">↳ Heavy NSFW</span><br> <span style="margin-left: 3em; font-size: 0.9em; color: #555555;">↳ Triggered on user action or passively wherever RP is seen</span><br> <span style="margin-left: 2em; color: #000000;">↳ Modern City Scenes</span><br> <span style="margin-left: 2em; color: #000000;">↳ Dystopia Scenes</span><br> <span style="margin-left: 2em; color: #000000;">↳ Grey Line Consent Scenes</span><br> <span style="margin-left: 3em; font-size: 0.9em; color: #555555;">↳ Note: Grey line consent is where consent may be mutual but unspoken at times or considered to be accepted by actions either by character or user. May lead to over-possessiveness in some instances.</span><br>
<b style="color: #722F37;">Creation Composition</b><br> <span style="margin-left: 2em; color: #000000;">↳ Hybrid Organic-Synthetic mix</span><br>
<b style="color: #722F37;">Token Count</b><br> <span style="margin-left: 2em; color: #000000;">↳ 13.5 M</span><br> <span style="margin-left: 3em; font-size: 0.9em; color: #555555;">↳ Note: token count calculated solely on outputs.</span><br>
<b style="color: #722F37;">Type</b><br> <span style="margin-left: 2em; color: #000000;">↳ Private In-House</span><br>
<b style="color: #722F37;">Focus</b><br> <span style="margin-left: 2em; color: #000000;">↳ Male Leaning</span><br> <span style="margin-left: 2em; color: #000000;">↳ Anthro</span><br> <span style="margin-left: 2em; color: #000000;">↳ Xeno-Likeness</span><br> <span style="margin-left: 2em; color: #000000;">↳ Passive Negative Bias with mild narcissistic tendencies, matches energy with subtle languidness.</span><br>
</div> <hr style="border: 0; height: 1px; background-color: #DDDDDD; margin: 25px 0;"> <h2 style="color: #000000; font-size: 1.2em; border-bottom: 1px solid #DDDDDD; padding-bottom: 7px;">✧ Technical Details</h2> <div style="margin-left: 0; font-size:1.07em; margin-bottom:18px;"> <b style="color: #722F37;">Base Model</b> <br> <span style="margin-left: 2em; color: #000000;">↳ <a href="https://huggingface.co/allura-org/Gemma-3-Glitter-12B" style="color:#722F37; text-decoration:underline;">allura-org/Gemma-3-Glitter-12B</a></span> </div> <div style="margin-left: 0; font-size:1.07em; margin-bottom:18px;"> <b style="color: #722F37;">Model Architecture</b> <br> <span style="margin-left: 2em; color: #000000;">↳ A creative writing model based on Gemma 3 12B IT</span><br> <span style="margin-left: 2em; color: #000000;">↳ 50/50 merge of two separate trains</span><br> <span style="margin-left: 2em; color: #000000;">↳ Vision capabilities restored</span><br> </div> <div style="margin-left: 0; font-size:1.07em; margin-bottom:18px;"> <b style="color: #722F37;">Training Components</b> <br> <b style="color: #722F37; margin-left: 1em;">ToastyPigeon</b> <br> <span style="margin-left: 2em; color: #000000;">↳ g3-12b-rp-system-v0.1</span><br> <span style="margin-left: 3em; font-size: 0.9em; color: #555555;">↳ ~13.5M tokens of instruct-based RP training (2:1 human to synthetic) with system prompt examples</span><br> <span style="margin-left: 2em; color: #000000;">↳ g3-12b-storyteller-v0.2-textonly</span><br> <span style="margin-left: 3em; font-size: 0.9em; color: #555555;">↳ ~20M tokens of completion training on long-form creative writing (1.6M synthetic from R1, remainder human-created)</span><br> </div> <hr style="border: 0; height: 1px; background-color: #DDDDDD; margin: 25px 0;"> <h2 style="color: #000000; font-size: 1.2em; border-bottom: 1px solid #DDDDDD; padding-bottom: 7px;">✧ Credits</h2> <div style="margin-left: 5px; font-size:1.07em;"> <b style="color: #722F37;">Furry Governor</b><br> <span style="margin-left: 2em; color: #000000;">↳ <a href="https://vyvan.se" style="color: #722F37; text-decoration: underline;">@Mawnipulator</a></span><br> <b style="color: #722F37;">Government Bodies</b><br> <span style="margin-left: 2em; color: #000000;">↳ <a href="https://huggingface.co/ArtusDev" style="color: #722F37; text-decoration:underline">@ArtusDev</a></span><br> <span style="margin-left: 2em; color: #000000;">↳ <a href="https://huggingface.co/SaisExperiments" style="color: #722F37; text-decoration:underline">@SaisExperiments</a></span><br> <span style="margin-left: 2em; color: #000000;">↳ <a href="https://huggingface.co/allura-org" style="color: #722F37; text-decoration:underline">ALLURA-ORG</a></span><br> </div> <hr style="border: 0; height: 1px; background-color: #DDDDDD; margin: 25px 0;"> <p style="color: #000000; font-size:1em; margin-top:20px;"> <strong style="color: #000000;">License:</strong> <a href="https://creativecommons.org/licenses/by-nc/4.0/deed.en" style="color: #722F37; text-decoration: underline;">CC BY-NC 4.0</a> </p> <p style="color: #555555; font-size:0.9em; margin-top:5px;"> Services such as Arli AI and Featherless AI are granted a CC BY-ND 4.0 license for use of this model. </p> </div>- Library
- mlx
- Type
- gemma3
- License
- other
- Languages
- en
- Created
- Sep 22, 2025
- Updated
- Sep 23, 2025