Downloads · 30 days
31
11% of all-time downloads
turboderp/GLM-4.6V-exl3
GLM-4.6V-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Downloads · 30 days
31
11% of all-time downloads
All-time downloads
273
Public
Repo size
463 GB
Likes
8
Public
Click a slice to open those files.
Other1.5 KB · 55%
From the Hugging Face model README
EXL3 quants of GLM-4.6V
⚠️ Requires ExLlamaV3 v0.0.18 (or v0.0.17 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
Optimized:
2.13 bits per weight
2.32 bits per weight
2.55 bits per weight
2.80 bits per weight
3.13 bits per weight
3.55 bits per weight
4.07 bits per weight