MiniMax-M2.7-GGUF

Notes

• 04-15-2026: I've uploaded a working Q4_K_M using the findings from Unsloth regarding the blk.61.ffn_down_exps causing the nan issue, for the Q4_K_M I've quantized that specific tensor to Q6_K.
• 04-12-2026: The Q4_K_M I uploaded seems to have some issues, the PPL / KLD was throwing nan so I'll remove the model for now and try to get a working quant up tomorrow.

Description

This repo contains specialized MoE-quants for MiniMax-M2.7. The idea being that given the huge size of the FFN tensors compared to the rest of the tensors in the model, it should be possible to achieve a better quality while keeping the overall size of the entire model smaller compared to a similar naive quantization. To that end, the quantization type default is kept in high quality and the FFN UP + FFN GATE tensors are quanted down along with the FFN DOWN tensors.