Downloads · 30 days
36
18% of all-time downloads
amanwalksdownthestreet/GLM-4.5-Air-Derestricted-exl3
GLM-4.5-Air-Derestricted-exl3 is a text generation model from amanwalksdownthestreet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
ExLlamaV3 quantizations of GLM-4.5-Air-Derestricted with tensor-level (L3) optimization and boosted attention layers.
Downloads · 30 days
36
18% of all-time downloads
All-time downloads
204
Public
Repo size
624 GB
Likes
2
Public
Click a slice to open those files.
.json1.3 MB · 100%
From the Hugging Face model README
ExLlamaV3 quantizations of GLM-4.5-Air-Derestricted with tensor-level (L3) optimization and boosted attention layers.
Using the provided measurement.json file and base quants, additional optimized quantizations can be made in seconds at any reasonable bpw. All work done with ExLlamaV3 v0.0.18.
VRAM-targeted quants using exl3's measure.py → optimize.py → recompile.py pipeline with attention boost.
| Branch | Size | bpw | Target |
|---|---|---|---|
| 3.15bpw-h6-opt | 41 GB | 3.15 | 48GB @ 128k |
| 4.37bpw-h6-opt | 56 GB | 4.37 | 64GB @ 128k |
| 5.00bpw-h6-opt | 64 GB | 5.00 | 72GB @ 128k |
| 6.33bpw-h6-opt | 80 GB | 6.33 | 96GB @ 128k |
Note: The 6.33bpw quant hit the optimization ceiling - targeting 6.94bpw produced 6.18bpw pre-boost output (6.33 after attention boost), indicating all beneficial tensor swaps exhausted.