Downloads · 30 days
230
4% of all-time downloads
exdysa/MiniMax-M2.7-REAP-172B-A10B-GGUF
MiniMax-M2.7-REAP-172B-A10B-GGUF is a text generation model from exdysa. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
[!IMPORTANT] Original Model Link : saricles/MiniMax-M2.7-REAP-172B-A10B-BF16
Downloads · 30 days
230
4% of all-time downloads
All-time downloads
5.7K
Public
Repo size
720 GB
Likes
9
Public
Click a slice to open those files.
.gguf720 GB · 100%
From the Hugging Face model README
[!IMPORTANT] Original Model Link : saricles/MiniMax-M2.7-REAP-172B-A10B-BF16
name: MiniMax-M2.7-REAP-172B-A10B-GGUF
base_model: MiniMaxAI/MiniMax-M2.7
license: other
pipeline_tag: text-generation
tasks: text-generation
language: en
library_name: llama.cpp
tags:
- Cerebras
- MiniMaxAI
- M2.7
- REAP
- GGUF
- static quantization
This is a 230 billion parameter MiniMax M2.5 model with 25% of its experts pruned with REAP (Router-weighted Expert Activation Pruning), then converted to GGUF with llama.cpp and static quantized.
Command sequence using source version of llama.cpp from source and /opt/homebrew/Cellar/llama.cpp/8680 llama-quantize:
hf download saricles/MiniMax-M2.7-REAP-172B-A10B-BF16 --local-dir MiniMax-M2.7-REAP-172B-A10B-BF16
python -m convert_hf_to_gguf ~/Downloads/MiniMax-M2.7-REAP-172B-A10B-BF16
llama-quantize MiniMax-M2.5-REAP-172B-A10B-BF16.gguf Q4_K_M