Downloads · 30 days
398
51% of all-time downloads
GLM-5.3-MLX-4.5bit
spicyneuron/GLM-5.3-MLX-4.5bit
GLM-5.3-MLX-4.5bit is a text generation model from spicyneuron. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as other.
zai-org/GLM-5.3-BF16 optimized for running on a Mac Studio M3 512.
All-time downloads
774
Public
Parameters
743B
421 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors421 GB · 100%
Parameter types
How the weights are stored.
U32743B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
zai-org/GLM-5.3-BF16 optimized for running on a Mac Studio M3 512.
- A mixed-precision quant that balances speed, memory, and accuracy.
- 4-bit baseline with important layers at higher precision.
- Fits into ~420 GB memory, leaving enough room for a smaller utility model.
Methodology
Quantized with a mlx-lm fork. MLX quantization options differ than llama.cpp, but the principles are the same:
- Sensitive layers like MoE routing, attention, and output embeddings get higher precision
- More tolerant layers like MoE experts get lower precision
- Task
- Text Generation
- Library
- mlx
- Type
- glm_moe_dsa
- License
- other
- Languages
- en, zh
- Created
- Aug 31, 2026
- Updated
- Aug 31, 2026