Downloads · 30 days
13
4% of all-time downloads
thad0ctor/MiniMax-M2.5-Q6_K-GGUF
MiniMax-M2.5-Q6_K-GGUF is a machine learning model from thad0ctor. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
GGUF quantization of MiniMaxAI/MiniMax-M2.5, created with llama.cpp.
Downloads · 30 days
13
4% of all-time downloads
All-time downloads
345
Public
Repo size
188 GB
Likes
0
Public
Click a slice to open those files.
.gguf188 GB · 100%
From the Hugging Face model README
GGUF quantization of MiniMaxAI/MiniMax-M2.5, created with llama.cpp.
| Property | Value |
|---|---|
| Base model | MiniMaxAI/MiniMax-M2.5 |
| Architecture | Mixture of Experts (MoE) |
| Total parameters | 230B |
| Active parameters | 10B per token |
| Layers | 62 |
| Total experts | 256 |
| Active experts per token | 8 |
| Source precision | FP8 (float8_e4m3fn) |
| Quantization | Size | Description |
|---|---|---|
| Q6_K | 175 GB | 6-bit K-quant, strong quality/size balance |
These GGUFs can be used with llama.cpp and compatible frontends.
# Example with llama-cli
llama-cli -m MiniMax-M2.5.Q6_K.gguf -p "Hello" -n 128
float8_e4m3fn) precision.MiniMaxAI/MiniMax-M2.5 weights.