Downloads · 30 days
10
1% of all-time downloads
ArtusDev/nbeerbower_EVA-abliterated-TIES-Qwen2.5-72B-AWQ
nbeerbower_EVA-abliterated-TIES-Qwen2.5-72B-AWQ is a text generation model from ArtusDev. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
AWQ quant of nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B using <a href="https://github.com/casper-hansen/AutoAWQ/"AutoAWQ</a for quantization.
Downloads · 30 days
10
1% of all-time downloads
All-time downloads
812
Public
Parameters
72.7B
41.5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors41.5 GB · 100%
How the weights are stored.
I3270.2B · 97%
From the Hugging Face model README
AWQ quant of nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B using <a href="https://github.com/casper-hansen/AutoAWQ/">AutoAWQ</a> for quantization.
Model was quantized down to INT4 using GEMM kernels, with zero-point quantization and a group size of 128.