Downloads · 30 days
0
0% of all-time downloads
gghfez/GLM-4.6-REAP-266B-A32B-Q2_K
GLM-4.6-REAP-266B-A32B-Q2_K is a text generation model from gghfez. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
371
Public
Repo size
—
Likes
2
Public
Click a slice to open those files.
Other1.6 KB · 54%
From the Hugging Face model README
UPDATE:
Due to HF storage limits, the GGUF files have been move to modelscope:
quantzor/GLM-4.6-REAP-266B-A32B-Q2_K
This is Q2_K_M gguf quant of AesSedai/GLM-4.6-REAP-266B-A32B
AesSedai/GLM-4.6-REAP-266B-A32B was created using REAP (Router-weighted Expert Activation Pruning), a novel expert pruning method that selectively removes redundant experts while preserving the router's independent control over remaining experts.
See the GLM-4.5-Air version by Cerebras for more details cerebras/GLM-4.5-Air-REAP-82B-A12B
Note: currently non-functional because of missing mtp.safetensors file and entry in model.safetensors.index.json
Forked from https://github.com/CerebrasResearch/reap to https://github.com/AesSedai/reap to hack in GLM-4.6 support.
Produced with:
bash experiments/pruning-cli.sh 0,1,2,3,4,5,6,7 zai-org/GLM-4.6 reap 42 0.25 theblackcat102/evol-codealpaca-v1 true true true false false