Downloads · 30 days
216
3% of all-time downloads
MiMo-7B-RL-nomtp-GGUF
quantflex/MiMo-7B-RL-nomtp-GGUF
MiMo-7B-RL-nomtp-GGUF is a text generation model from quantflex. Use it when you need the model to write or continue text. The card lists the license as mit.
All-time downloads
6.5K
Public
Repo size
55 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf55 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Apr 30, 2025
- Updated
- May 1, 2025
- SHA
- b4054c35
Base models
Model card
From the Hugging Face model README
---- NOTE -----
I have deleted the mtp layers in order to make it work with llama.cpp. Quality might be degraded.
A proper implementation would be better, but this will work until that is implemented.
For more information feel free to open a discussion here.
Here is a tutorial on how I made these quants without mtp:
https://huggingface.co/XiaomiMiMo/MiMo-7B-RL/discussions/5
---- NOTE -----
GGUF Quants for: XiaomiMiMo/MiMo-7B-RL
Model by: XiaomiMiMo
Quants by: quantflex
Run with llama.cpp:
./llama-cli -m MiMo-7B-RL-nomtp-Q5_K_M.gguf -cnv
- Task
- Text Generation
- License
- mit
- Languages
- zh, en
- Created
- Apr 30, 2025
- Updated
- May 1, 2025