Downloads · 30 days
15
27% of all-time downloads
ClonedGizzards/Huihui-GLM-4.5-Air-abliterated-lossytensors
Huihui-GLM-4.5-Air-abliterated-lossytensors is a text generation model from ClonedGizzards. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a lossy safetensors version of Huihui-GLM-4.5-Air-abliterated-GGUF that can be run with huggingface transformers, since the original release did not include safetensors files.
Downloads · 30 days
15
27% of all-time downloads
All-time downloads
56
Public
Parameters
110B
221 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors221 GB · 100%
From the Hugging Face model README
This is a lossy safetensors version of Huihui-GLM-4.5-Air-abliterated-GGUF that can be run with huggingface transformers, since the original release did not include safetensors files.
It was re-converted back into .safetensors manually from the Q4_K_M GGUF file.
As such, although the weights are now in BF16, it is considered a "lossy" version of inferior quality to the full precision model.
However, you should now be able to use it with backends that cannot use GGUF and require safetensors (e.g. MLX, VLLM).
Avoid requantizing it to formats above Q4_K_M - You will NOT gain any additional quality.
If you require the max precision version, you'll have to buy it from huihui.