glm52-idx-extract

GLM-5.2 — DSA indexer weights

Explore the model guide · All public work

Release at a glance

The DSA (sparse-attention) indexer weights extracted from zai-org/GLM-5.2 (743B total / 39B active, MIT), split out as a component artifact (197.2 MB of root tensor files in this revision).

GLM-5.2's attention uses a learned indexer to select a top-k subset of past tokens once the context exceeds index_topk, instead of attending densely over everything. Those indexer tensors are a tiny fraction of the model and are used by engines implementing GLM-5.2's sparse-attention path — and pulling them out of the full checkpoint otherwise means downloading large source shards to keep the small indexer payload.

Contents

• out-idx-*.safetensors — the extracted indexer tensors
• config.json / generation_config.json — GLM-5.2 config (GlmMoeDsaForCausalLM)
• _meta/ — tokenizer files

Use with iliria

iliria runs GLM-5.2 off SSD by streaming experts from disk. Its converter takes --keep-idx to produce exactly this artifact; this repo saves you that step. Point the engine at a container that includes these tensors and the DSA path activates once context passes index_topk.

Provenance

Derived from zai-org/GLM-5.2 (MIT). Extraction only — no retraining, no quantization of the indexer tensors themselves. The weights are unmodified values lifted from the source checkpoint.