Downloads · 30 days
145
8% of all-time downloads
culturerevolt/gemma-4-12b-heretic-abliterated-8bit-mlx
gemma-4-12b-heretic-abliterated-8bit-mlx is a text generation model from culturerevolt. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This repository features an Apple Silicon native 8-bit MLX quantization of culturerevolt/gemma-4-12b-heretic-abliterated.
Downloads · 30 days
145
8% of all-time downloads
All-time downloads
1.8K
Public
Parameters
12B
13 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors12.9 GB · 100%
How the weights are stored.
U3212B · 100%
From the Hugging Face model README
This repository features an Apple Silicon native 8-bit MLX quantization of culturerevolt/gemma-4-12b-heretic-abliterated.
The base model is an abliterated, fully decensored variant of Google's unified multimodal gemma-4-12b-it architecture, stripped of categorical refusal alignments via norm-preserving directional ablation. This configuration is compiled explicitly for high-performance inference on Mac hardware using the MLX framework.
This file uses uniform group-wise quantization optimized for unified memory architectures. Every tensor is split into precise channel blocks to isolate and protect outlier weights naturally.
To ensure smooth generation, clean formatting, and proper instruction adherence in native Mac backends like LM Studio or the MLX command line tool, implement the following structures:
Gemma-4 is built on a unified, encoder-free architecture. It processes visual patches and audio waveforms natively without requiring an external vision transformer module. Ensure your choice of frontend is configured to look for the companion Gemma-4-12B scale multimodal projector artifacts to fully enable media ingestion capabilities.
This model is completely unaligned. It will output text without filtering, judgment, or warning labels. By downloading this model, you accept full responsibility for the prompts fed to it and the text generated by it. Use responsibly within local sandbox development setups.
If you encounter interface parsing issues with heavy multi-turn configurations, use this clean, hyper-efficient template to ensure maximum token stability:
{%- for message in messages %}
<|turn|>{{ message['role'] }}
{{ message['content'] }}<|turn|>
{%- endfor %}
{%- if add_generation_prompt %}
<|turn|>assistant<|channel>thought <channel|>
{%- endif %}