GLM-4.6V-Flash-GGUF

GLM-4.6V-Flash-GGUF

The GLM-4.6V-Flash from zai-org is a lightweight 9B-parameter vision-language model in the GLM-4.6V series, optimized for local deployment and low-latency applications with a 128K token context window, achieving state-of-the-art visual understanding performance among similar-scale models through native multimodal function calling that bridges perception to executable actions. It enables direct tool use with images, screenshots, and document pages as inputs—without text conversion—while interpreting visual outputs like charts and rendered pages, supporting multimodal document understanding for complex image-heavy content, frontend replication from UI screenshots with pixel-accurate HTML/CSS generation, and natural-language-driven visual editing. Designed for real-world multimodal agents in business scenarios, it excels in joint comprehension of text, layouts, tables, and figures, with scalable deployment via cloud/high-performance clusters for its larger 106B sibling.

GLM-4.6V-Flash [GGUF]

text-only

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):