EXL3 quants of GLM-4.5-Air
2.00 bits per weight
2.25 bits per weight (optimized)
2.50 bits per weight (optimized)
3.00 bits per weight
3.07 bits per weight (optimized)
3.50 bits per weight (optimized)
4.00 bits per weight
<table>
<tr>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/2.0bpw.svg">
<img src="2.0bpw.svg" alt="2.00 bpw" width="160">
</a>
<div>2.00 bpw</div>
</td>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/2.25bpw.svg">
<img src="2.25bpw.svg" alt="2.25 bpw" width="160">
</a>
<div>2.25 bpw</div>
</td>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/2.5bpw.svg">
<img src="2.5bpw.svg" alt="2.5 bpw" width="160">
</a>
<div>2.50 bpw</div>
</td>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/3.0bpw.svg">
<img src="3.0bpw.svg" alt="3.00 bpw" width="160">
</a>
<div>3.00 bpw</div>
</td>
</tr>
<tr>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/3.07bpw.svg">
<img src="3.07bpw.svg" alt="3.07 bpw" width="160">
</a>
<div>3.07 bpw</div>
</td>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/3.5bpw.svg">
<img src="3.5bpw.svg" alt="3.50 bpw" width="160">
</a>
<div>3.50 bpw</div>
</td>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/4.0bpw.svg">
<img src="4.0bpw.svg" alt="4.00 bpw" width="160">
</a>
<div>4.00 bpw</div>
</td>
<td align="center">
<a href="https://huggingface.co/turboderp/GLM-4.5-Air-exl3/blob/main/api.svg">
<img src="api.svg" alt="API" width="160">
</a>
<div>API</div>
</td>
</tr>
</table>
