Downloads · 30 days
21
27% of all-time downloads
GLM-5.2-colibri-int4-with-int8-mtp
Distillio/GLM-5.2-colibri-int4-with-int8-mtp
GLM-5.2-colibri-int4-with-int8-mtp is a machine learning model from Distillio. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is the EXACT SAME THING as https://huggingface.co/jlnsrk/GLM-5.2-colibri-int4, BUT with int8 MTP heads, which are needed for speculative decoding—and with that, an overall major inference speedboost. The original…
All-time downloads
78
Public
Repo size
389 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors384 GB · 100%
At a glance
- License
- mit
- Model type
- glm_moe_dsa
- Access
- Public
- Created
- Jul 22, 2026
- Updated
- Jul 22, 2026
- SHA
- 2f12424e
Base models
Model card
From the Hugging Face model README
GLM-5.2 — colibrì int4 container (~370 GB)
This is the *EXACT SAME THING* as https://huggingface.co/jlnsrk/GLM-5.2-colibri-int4, BUT with int8 MTP heads, which are needed for speculative decoding—and with that, an overall major inference speedboost. The original int4 MTP heads have low acceptance rate, and are essentially useless.
⚠️ This is NOT a GGUF / AWQ / GPTQ / MLX model. It only works with the colibrì engine.
Usage
# Get the engine
git clone https://github.com/JustVugg/colibri && cd colibri/c && ./setup.sh
# download this repo to a FAST local disk
hf download mateogrgic/GLM-5.2-colibri-int4-with-int8-mtp --local-dir /nvme/glm52
# run on CPU
COLI_MODEL=/nvme/glm52 ./coli chat
Requirements: Linux (or WSL2), gcc + OpenMP, AVX2, ≥16 GB RAM, ~400 GB free NVMe.
Provenance & license
Converted from zai-org/GLM-5.2-FP8 (MIT). This derivative is likewise MIT. Conversion performed with colibrì's official converter, unmodified. Cloned & modded from jlnsrk/GLM-5.2-colibri-int4
- Type
- glm_moe_dsa
- License
- mit
- Languages
- en, zh
- Created
- Jul 22, 2026
- Updated
- Jul 22, 2026