Downloads · 30 days
60
7% of all-time downloads
ModelCloud/glm-4-9b-gptq-4bit
glm-4-9b-gptq-4bit is a machine learning model from ModelCloud. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
World's first gptq 4bit quant of glm-4-9b model.
Downloads · 30 days
60
7% of all-time downloads
All-time downloads
839
Public
Parameters
9.4B
6.7 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors6.7 GB · 100%
How the weights are stored.
I328.2B · 87%
From the Hugging Face model README
World's first gptq 4bit quant of glm-4-9b model.
Autogptq PR: https://github.com/AutoGPTQ/AutoGPTQ/pull/683
Please note ChatGLM has tendency to switch from English to Chinese in mid-reply or in direct reply to English prompt. This issue happens in both native and quantized model and needs further investigation.