Downloads · 30 days
0
laion/glm-5.2-eval-tokenizer
glm-5.2-eval-tokenizer is a machine learning model from laion. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Tokenizer-only artifact for evaluating cyankiwi/GLM-5.2-AWQ-INT4 with Transformers 4.57.6. tokenizer.json and chattemplate.jinja are copied unchanged from model revision 956f4d228e36c95f66a80058fe64b69af67360ca.
Downloads · 30 days
0
Access
Public
Updated Aug 11, 2026
Repo size
20.2 MB
Likes
0
Public
Click a slice to open those files.
.json20.2 MB · 100%
From the Hugging Face model README
Tokenizer-only artifact for evaluating cyankiwi/GLM-5.2-AWQ-INT4 with
Transformers 4.57.6. tokenizer.json and chat_template.jinja are copied
unchanged from model revision 956f4d228e36c95f66a80058fe64b69af67360ca.
The source metadata names the unavailable TokenizersBackend class and stores
extra_special_tokens as a list, which Transformers 4.57.6 rejects. This
artifact names PreTrainedTokenizerFast and removes that redundant field. The
vocabulary and rendered chat templates are unchanged.