Downloads · 30 days
77
2% of all-time downloads
NexesQuants/zai-org_GLM-4.5-Air-bf16-iMat-IKL-CQ-GGUF
zai-org_GLM-4.5-Air-bf16-iMat-IKL-CQ-GGUF is a machine learning model from NexesQuants. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
The IQ4XSL quant is meant to be run with IKLlama.cpp or the incoming EsoCroK.Cpp, because it uses a Q60 quant specific to IKLlama.cpp
Downloads · 30 days
77
2% of all-time downloads
All-time downloads
4.3K
Public
Repo size
399 GB
Likes
0
Public
Click a slice to open those files.
.gguf399 GB · 100%
From the Hugging Face model README
The IQ4_XS_L quant is meant to be run with IK_Llama.cpp or the incoming EsoCroK.Cpp, because it uses a Q6_0 quant specific to IK_Llama.cpp
Here's EsoCrok, compatible with the llama.cpp mainline quants AND Q6_0
https://github.com/Nexesenex/croco.cpp/releases/tag/v1.97200_b6119_RMv1.14.9m
The usual Croco has not been updated (yet?) to support properly GLM 4.5 (or OpenAI GPT OSS)