Downloads · 30 days
9
1% of all-time downloads
MiniMax-M2.7-Abliterated-Heretic-GGUF-UD
GreyManul/MiniMax-M2.7-Abliterated-Heretic-GGUF-UD
MiniMax-M2.7-Abliterated-Heretic-GGUF-UD is a text generation model from GreyManul. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
I'm using the Youssofal/MiniMax-M2.7-Abliterated-Heretic-GGUF model, but the q4 quantizations provided in the repository don't fit my system configuration (128GB RAM + 16GB VRAM), so I took the imatrix from unsloth (h…
All-time downloads
1.2K
Public
Repo size
108 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf108 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- May 15, 2026
- Updated
- May 16, 2026
- SHA
- 57152bb8
Try a prompt
Base models
Model card
From the Hugging Face model README
I'm using the Youssofal/MiniMax-M2.7-Abliterated-Heretic-GGUF model, but the q4 quantizations provided in the repository don't fit my system configuration (128GB RAM + 16GB VRAM), so I took the imatrix from unsloth (https://huggingface.co/unsloth/MiniMax-M2.7-GGUF/tree/main) and used their weights for quantization. Thanks a lot!
The advantage of unsloth's quantization is that it encodes different tensors with different precisions depending on their importance, so more important tensors are encoded with less loss. In the original (Youssofal) GGUF repository, all tensors are encoded with the same precision, which results in a significant loss of quality compared to unsloth's gguf.
So I tried to combine the best of both worlds.
- Task
- Text Generation
- Library
- gguf
- License
- other
- Created
- May 15, 2026
- Updated
- May 16, 2026