Downloads · 30 days
149
10% of all-time downloads
Serpen/Minimax-M3-MSA-GGUF
Minimax-M3-MSA-GGUF is a machine learning model from Serpen. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repo contains specialized MoE-quants for MiniMax-M3 with the Indexer Tensors preserved at FP32. A BF16 MMPROJ file for image vision input has also been provided.
Downloads · 30 days
149
10% of all-time downloads
All-time downloads
1.5K
Public
Repo size
331 GB
Likes
1
Public
Click a slice to open those files.
.gguf266 GB · 83%
From the Hugging Face model README
This repo contains specialized MoE-quants for MiniMax-M3 with the Indexer Tensors preserved at FP32. A BF16 MMPROJ file for image vision input has also been provided.
The text model files should load on mainline as this PR got merged. The MMPROJ requires this one, which is a superset of the first PR.
| Quant | Size | Mixture | PPL | 1-(Mean PPL(Q)/PPL(base)) | KLD |
|---|---|---|---|---|---|
| Q4_K_M | 246.11 GiB (4.96 BPW) | Q8_0 / Q4_K / Q4_K / Q5_K | 5.287961 ± 0.035451 | +1.9814% | 0.069890 ± 0.000978 |
