MiMo-V2.5-Pro-GGUF

Notes

• 05/07/26: Unless some really asks for the Q8_0, I'm not planning on uploading it due to HF storage space constraints. Bartowski / Unsloth should have the Q8_0 quant when they get to this model.

Model

This repo contains specialized MoE-quants for MiMo-V2.5-Pro. The idea being that given the huge size of the FFN tensors compared to the rest of the tensors in the model, it should be possible to achieve a better quality while keeping the overall size of the entire model smaller compared to a similar naive quantization. To that end, the quantization type default is kept in high quality and the FFN UP + FFN GATE tensors are quanted down along with the FFN DOWN tensors.