GLM-4.7-Flash-HLWQ-Q5

[!IMPORTANT] Naming notice (2026-04-10). The "HLWQ" technique used in this model is being rebranded to HLWQ (Hadamard-Lloyd Weight Quantization). The change is only the name; the algorithm and the weights in this repository are unchanged.

The rebrand resolves a name collision with an unrelated, earlier KV cache quantization method also named HLWQ (Han et al., arXiv:2502.02617, 2025). HLWQ addresses weight quantization with a deterministic Walsh-Hadamard rotation and Lloyd-Max scalar codebook; Han et al.'s HLWQ addresses KV cache quantization with a random polar rotation. The two methods are technically distinct.

Existing loaders that load this repository by ID continue to work without changes. Future model uploads will use the HLWQ name.

Reference paper for this technique: arXiv:2603.29078 (v2 in preparation; v1 still uses the old name).

GLM-4.7-Flash — HLWQ Q5 (Bit-Packed)

PQ5+INT4 weights for consumer GPU inference.

30B-A3B MoE | MLA attention | MIT license | 22.2 tok/s

61 GB → 19 GB (-69%) | cos_sim >0.998 | 6,265 layers quantized

Download Size

Compression

Per-component "Original" sizes are estimated breakdowns — only the total 61 GB was directly measured from the full BF16 download.

Benchmarks

Quality Validation

• TCP vs UDP: Correct, structured explanation with thinking
• Sieve of Eratosthenes: Correct Python implementation
• Aurora Borealis: Accurate physics explanation

Architecture

• 47 layers, hidden=2048, 20 heads
• MLA (Multi-head Latent Attention) — compressed KV via lora_rank=512
• 64 MoE experts, 4 active per token, 1 shared expert
• 131K context length
• Speculative decoding support (MTP)
• MIT license — fully open

Hardware

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

# Load PQ5 codes and dequant
# See setup instructions at github.com/caiovicentino/polarengine-vllm

# Or use vLLM for serving:
# vllm serve zai-org/GLM-4.7-Flash --tool-call-parser glm47

Links

• HLWQ Paper
• GitHub
• Base Model

Citation

@article{polarquant2026,
  title={HLWQ: Hadamard-Rotated Lloyd-Max Quantization},
  author={Vicentino, Caio},
  journal={arXiv preprint arXiv:2603.29078},
  year={2026}
}

---

61 GB → 19 GB with cos_sim >0.998. MIT license. Quantized with HLWQ.