Downloads · 30 days
31
7% of all-time downloads
0xSero/GLM-5.3-488B-EXL3-TR3-3.42bpw
GLM-5.3-488B-EXL3-TR3-3.42bpw is a text generation model from 0xSero. Use it when you need the model to write or continue text. The card lists the license as other.
[!TIP] Support this work → · X · GitHub · REAP paper · Cerebras REAP
Downloads · 30 days
31
7% of all-time downloads
All-time downloads
436
Public
Parameters
121B
242 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors242 GB · 100%
How the weights are stored.
I16101B · 84%
From the Hugging Face model README
[!TIP] Support this work → · X · GitHub · REAP paper · Cerebras REAP
GLM-5.3 with 36% of its experts removed — 242 GB, fits within ~300 GB of VRAM. A REAP prune applied directly to davidsyoung/GLM-5.3-EXL3-TR3-3.42bpw, the standard-compliant EXL3 quant (routed experts quantized, sensitive layers BF16).
GLM-5.3 is a 753B mixture-of-experts model (8 of 256 experts per token, ~40B active). This checkpoint keeps 164 of 256 routed experts per layer, chosen by the max-over-domain saliency criterion (each expert scored by its largest share of any single domain's routed work, so every domain keeps its specialists). Whole experts are dropped, the survivors renumbered, and the routers + MTP layer sliced to match — applied byte-exact to the already-quantized checkpoint, so nothing is re-quantized.
| Base | davidsyoung/GLM-5.3-EXL3-TR3-3.42bpw (EXL3 trellis, experts-only quant, BF16 sensitive) |
| Prune | REAP keep-164/256 (36% removed), max-over-domain saliency, all MoE layers + MTP |
| Size | 242 GB (fits within 300 GB VRAM) |
| KL vs BF16 | measured on GPU — see the fidelity study |
Loads in exllamav3 / TabbyAPI, tensor-split across your GPUs.
Inherits the GLM-5.3 license.