Downloads · 30 days
28
1% of all-time downloads
GLM-5.1-FP8_dq4-mlx
cs2764/GLM-5.1-FP8_dq4-mlx
GLM-5.1-FP8_dq4-mlx is a text generation model from cs2764. Use it when you need the model to write or continue text. It is set up for mlx.
This model is a DQ4 quantized version of the original model GLM-5.1-FP8. It was quantized locally using the mlxlm library.
All-time downloads
2.8K
Public
Parameters
744B
436 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors435 GB · 100%
Parameter types
How the weights are stored.
U32744B · 100%
Try a prompt
Model card
From the Hugging Face model README
GLM-5.1-FP8_dq4
This model is a DQ4 quantized version of the original model [GLM-5.1-FP8](Local Model).
It was quantized locally using the mlx_lm library.
Quantization Methodology (DQ4)
This model was quantized using the dynamic DQ4 (4-bit / 5-bit / 6-bit / 8-bit mixed) approach, inspired by the methodology described in the mlx-community/Kimi-K2.5-mlx-DQ3_K_M-q8 repository.
The weights are mixed based on MLX layers:
- Expert layers (switch_mlp / mlp) are quantized to 4-bit.
- The first 5 layers are kept at higher quality (6-bit).
- Every 5th layer is medium quality (5-bit).
- All other layers (e.g. attention, normalization) remain at 8-bit to serve as the "8-bit brain".
- Task
- Text Generation
- Library
- mlx
- Type
- glm_moe_dsa
- Created
- Apr 8, 2026
- Updated
- Apr 8, 2026