Downloads · 30 days
27
2% of all-time downloads
GLM-4.7-REAP-268B-A32B-MXFP4_MOE_GGUF
andyjack/GLM-4.7-REAP-268B-A32B-MXFP4_MOE_GGUF
GLM-4.7-REAP-268B-A32B-MXFP4_MOE_GGUF is a machine learning model from andyjack. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Introducing GLM-4.7-REAP-268B-A32B, a memory-efficient compressed variant of GLM-4.7 that maintains near-identical performance while being 25% lighter.
All-time downloads
1.2K
Public
Repo size
152 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf152 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Mar 11, 2026
- Updated
- Jun 21, 2026
- SHA
- e7ee0f4e
Model card
From the Hugging Face model README
Introducing GLM-4.7-REAP-268B-A32B, a memory-efficient compressed variant of GLM-4.7 that maintains near-identical performance while being 25% lighter.
The original model available here: https://huggingface.co/cerebras/GLM-4.7-REAP-268B-A32B
Note: this is a MXFP4-MOE accurate downstream low-bit quantization version. It has been tested with the latest version of llama.cpp.
llama.cpp/build/bin/llama-server
-m GLM-4.7-REAP-268B-A32B-MXFP4_MOE.gguf
--host 0.0.0.0
--port 11434
--api-key XXX
--flash-attn on
--n-gpu-layers 99
--split-mode layer
--no-mmap
--repeat-penalty 1.08
--repeat-last-n 256
-c 128000
-b 4096
-ub 1024
--parallel 1
--jinja
bitcoin:
bc1q6nvh39fcmy0de0ezepnn2z0rn4dme9yjal77ah
- License
- mit
- Created
- Mar 11, 2026
- Updated
- Jun 21, 2026