Downloads · 30 days
42
3% of all-time downloads
exdysa/MiniMax-M2.7-REAP-139B-A10B-MLX-4bit
MiniMax-M2.7-REAP-139B-A10B-MLX-4bit is a text generation model from exdysa. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as other.
[!IMPORTANT] Original Model Link : dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B
Downloads · 30 days
42
3% of all-time downloads
All-time downloads
1.3K
Public
Parameters
139B
78.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors78.3 GB · 100%
How the weights are stored.
U32139B · 100%
From the Hugging Face model README
[!IMPORTANT] Original Model Link : dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B
name: MiniMax-M2.7-REAP-139B-A10B-4bit
base_model: MiniMaxAI/MiniMax-M2.7
license: other
license_name: modified-mit
license_link: https://huggingface.co/MiniMaxAI/MiniMax-M2.7/blob/main/LICENSE
pipeline_tag: text-generation
tasks: text-generation
language: en
library_name: mlx
tags:
- Cerebras
- MiniMaxAI
- M2.7
- REAP
- MLX
- static quantization
- 4-bit
- moe
- pruning
- text-generation
- mlx
size: 79GB
This is a 230 billion parameter MiniMax M2.7 model with 40% of its experts pruned with REAP (Router-weighted Expert Activation Pruning), then converted to MLX with mlx_lm.
Conversion sequence using source version of [email protected] :
mlx_lm.convert --hf-path dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B --mlx-path ~/Downloads/MiniMax-M2.7-REAP-139B-A10B-MLX-4bit -q --q-bits 4