Downloads · 30 days
67
11% of all-time downloads
GLM-4.7-REAP-30-W4A16
Jon-Nielsen/GLM-4.7-REAP-30-W4A16
GLM-4.7-REAP-30-W4A16 is a text generation model from Jon-Nielsen. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 4-bit AutoRound GPTQ quantization of 0xSero/GLM-4.7-REAP-30, a 30% REAP-pruned version of the original GLM-4.7 MoE model.
All-time downloads
584
Public
Parameters
1.6B
134 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors134 GB · 100%
Parameter types
How the weights are stored.
I32250B · 99%
Try a prompt
Base models
Model card
From the Hugging Face model README
GLM-4.7-REAP-30 4-bit GPTQ Quantization
This is a 4-bit AutoRound GPTQ quantization of 0xSero/GLM-4.7-REAP-30, a 30% REAP-pruned version of the original GLM-4.7 MoE model.
- Quantized with AutoRound v0.9.4 (
bits=4,group_size=128,sym=True) in auto_gptq format. - Model size: ~124 GB (3.8x compression from the unquantized pruned model).
- Compatible with vLLM, Transformers + AutoGPTQ, ExLlamaV2, etc.
Example vLLM serving command
(tested on 2x NVIDIA RTX PRO 6000 Blackwell with the following settings)
vllm serve Jon-Nielsen/GLM-4.7-REAP-30-W4A16 \
--tensor-parallel-size 2 \
--kv-cache-dtype fp8 \
--gpu-memory-utilization 0.96 \
--max-model-len 196608 \
--max-num-seqs 8 \
--max-num-batched-tokens 16384 \
--trust-remote-code \
--enable-prefix-caching \
--enable-chunked-prefill \
--enable-expert-parallel \
--tool-call-parser=glm47 \
--reasoning-parser=glm45 \
--enable-auto-tool-choice \
--disable-custom-all-reduce
- Task
- Text Generation
- Library
- transformers
- Type
- glm4_moe
- License
- apache-2.0
- Languages
- en
- Created
- Jan 7, 2026
- Updated
- Jan 8, 2026