Downloads · 30 days
1.7K
76% of all-time downloads
axiomofmind/GLM-5.3-Flash-W4A16-NVFP4-GGUF
GLM-5.3-Flash-W4A16-NVFP4-GGUF is a text generation model from axiomofmind. Use it when you need the model to write or continue text. The card lists the license as mit.
GGUF conversion of axiomofmind/GLM-5.3-Flash-W4A16-NVFP4, based on zai-org/GLM-5.3-Flash-BF16.
Downloads · 30 days
1.7K
76% of all-time downloads
All-time downloads
2.2K
Public
Repo size
204 GB
Likes
0
Public
Click a slice to open those files.
.gguf204 GB · 100%
From the Hugging Face model README
GGUF conversion of
axiomofmind/GLM-5.3-Flash-W4A16-NVFP4,
based on zai-org/GLM-5.3-Flash-BF16.
The main-model routed experts use W4A16 NVFP4 with group size 16. Attention, shared experts, routers, embeddings, the output head, MTP weights, and other retained tensors remain in BF16 or F32.
| File | Description | Size |
|---|---|---|
GLM-5.3-Flash-W4A16-NVFP4-BF16attn-MTP.gguf | Text model with MTP weights | 204.1 GB |
A llama.cpp build with GLM5Next and NVFP4 GGUF support is required.
This model is distributed under the MIT License. Refer to the official model card for architecture details, usage guidance, and limitations.