Downloads · 30 days
36
3% of all-time downloads
gghfexp/MiniMax-M3-IQ2_KT-experimental
MiniMax-M3-IQ2_KT-experimental is a machine learning model from gghfexp. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
⚠️ These are untested artifacts from an experimental ikllama.cpp quant pipeline
Downloads · 30 days
36
3% of all-time downloads
All-time downloads
1.3K
Public
Repo size
119 GB
Likes
4
Public
Click a slice to open those files.
.gguf119 GB · 100%
From the Hugging Face model README
⚠️ These are untested artifacts from an experimental ik_llama.cpp quant pipeline
This IQ2_KT quant (110.9 GiB):
Final estimate: PPL over 552 chunks for n_ctx=512 = 7.5871 +/- 0.05498
The IQ3_KT quant (156.9 GiB):
Final estimate: PPL over 552 chunks for n_ctx=512 = 6.0129 +/- 0.04200
Unsloth UD_Q4_K_M (246.7 GiB):
Final estimate: PPL over 552 chunks for n_ctx=512 = 5.2593 +/- 0.03521