Downloads · 30 days
48
6% of all-time downloads
gghfez/GLM-4.7-Q8-GGUF
GLM-4.7-Q8-GGUF is a machine learning model from gghfez. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is just a simple q80 quant. I recommend these instead:
Downloads · 30 days
48
6% of all-time downloads
All-time downloads
835
Public
Repo size
381 GB
Likes
1
Public
Click a slice to open those files.
.gguf381 GB · 100%
From the Hugging Face model README
This is just a simple q8_0 quant. I recommend these instead:
For llama.cpp -> bartowski/zai-org_GLM-4.7-GGUF
For ik_llama.cpp -> ubergarm/GLM-4.7-GGUF
For exllamav3 -> mratsim/GLM-4.7-EXL3 - each quant size has it's own branch, I tested the 3.0_H6 and it works.