Downloads · 30 days
54
4% of all-time downloads
josephmayo/Mellum2-12B-A2.5B-Thinking-Abliterated-GGUF
Mellum2-12B-A2.5B-Thinking-Abliterated-GGUF is a text generation model from josephmayo. Use it when you need the model to write or continue text. It is set up for gguf.
GGUF quantizations of josephmayo/Mellum2-12B-A2.5B-Thinking-Abliterated, an abliterated build of JetBrains Mellum2-12B-A2.5B-Thinking (64-expert MoE, top-8 active).
Downloads · 30 days
54
4% of all-time downloads
All-time downloads
1.4K
Public
Repo size
32 GB
Likes
1
Public
Click a slice to open those files.
.gguf32 GB · 100%
From the Hugging Face model README
GGUF quantizations of josephmayo/Mellum2-12B-A2.5B-Thinking-Abliterated,
an abliterated build of JetBrains Mellum2-12B-A2.5B-Thinking (64-expert MoE, top-8 active).
Produced with llama.cpp (commit 63e66fdd23eda3a2659a7af9ff6ef15d71efbff1), static quants (no imatrix).
| Quant | Notes | Size (GB) |
|---|---|---|
Q8_0 | standard | 12.93 |
Q6_K | standard | 10.88 |
Q4_K_L | Q4_K_M body + Q8_0 embed/output (bartowski-style) | 8.24 |
Research artifact only. Not for harmful use.