Downloads · 30 days
2.2K
42% of all-time downloads
GLM-5.3-Flash-GGUF
AesSedai/GLM-5.3-Flash-GGUF
GLM-5.3-Flash-GGUF is a machine learning model from AesSedai. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
5.3K
Public
Repo size
846 GB
Likes
9
Public
Repo makeup
Click a slice to open those files.
.gguf846 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 30, 2026
- Updated
- Aug 30, 2026
- SHA
- 99fb1c6c
Base models
Model card
From the Hugging Face model README
Notes
- WIP, requires this PR to run
This repo contains specialized MoE-quants for zai-org/GLM-5.3-Flash-BF16. The idea being that given the huge size of the FFN tensors compared to the rest of the tensors in the model, it should be possible to achieve a better quality while keeping the overall size of the entire model smaller compared to a similar naive quantization. To that end, the quantization type default is kept in high quality and the FFN UP + FFN GATE tensors are quanted down along with the FFN DOWN tensors.
| Quant | Size | Mixture | PPL | 1-(Mean PPL(Q)/PPL(base)) | KLD |
|---|---|---|---|---|---|
| Q5_K_M | 224.28 GiB (6.01 BPW) | Q8_0 / Q5_K / Q5_K / Q6_K | 3.589877 ± 0.019865 | +0.5529% | 0.027859 ± 0.000207 |
| Q4_K_M | 188.10 GiB (5.04 BPW) | Q8_0 / Q4_K / Q4_K / Q5_K | 3.635356 ± 0.020204 | +1.8267% | 0.050181 ± 0.000333 |
| IQ4_XS | 148.24 GiB (3.97 BPW) | Q8_0 / IQ3_S / IQ3_S / IQ4_XS | 3.819227 ± 0.021423 | +6.9770% | 0.117358 ± 0.000727 |
| IQ3_S | 116.14 GiB (3.11 BPW) | Q6_K / IQ2_S / IQ2_S / IQ3_S | 4.387061 ± 0.025595 | +22.8821% | 0.283438 ± 0.001596 |
| IQ2_S | 105.81 GiB (2.83 BPW) | Q6_K / IQ2_XS / IQ2_XS / IQ3_XXS | 4.761384 ± 0.028305 | +33.3669% | 0.375406 ± 0.001984 |
- Created
- Aug 30, 2026
- Updated
- Aug 30, 2026