Downloads · 30 days
1.5K
83% of all-time downloads
GLM-5.3-4bit
mlx-community/GLM-5.3-4bit
GLM-5.3-4bit is a text generation model from mlx-community. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as other.
This model mlx-community/GLM-5.3-4bit was converted to MLX format from zai-org/GLM-5.3-BF16 using mlx-lm version 0.31.3 (with PR 1410).
All-time downloads
1.8K
Public
Parameters
743B
418 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors418 GB · 100%
Parameter types
How the weights are stored.
U32743B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
mlx-community/GLM-5.3-4bit
This model mlx-community/GLM-5.3-4bit was converted to MLX format from zai-org/GLM-5.3-BF16 using mlx-lm version 0.31.3 (with PR #1410).
Note that this quant is using the GLM-5.3-BF16 as base. Testing various quant recipes, these often start to overthink and redoing "decisions". The standard 4-bit quant is stable and fast.
This is created for people using a single Apple Mac Studio M3 Ultra with 512 GB. The 4-bit version of GLM-5.3 fits comfortably.
You can find more similar MLX model quants for Apple Mac Studio with 512 GB at https://huggingface.co/bibproj
pip install mlx-lm
mlx_lm.generate --model mlx-community/GLM-5.3-4bit --prompt "Hi"
Enjoy!
- Task
- Text Generation
- Library
- mlx
- Type
- glm_moe_dsa
- License
- other
- Languages
- en, zh
- Created
- Sep 2, 2026
- Updated
- Sep 2, 2026