Downloads · 30 days
446
8% of all-time downloads
GLM-4.6V-Flash-GGUF
AaryanK/GLM-4.6V-Flash-GGUF
GLM-4.6V-Flash-GGUF is a image-text-to-text model from AaryanK. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as mit.
This repository contains GGUF format quantizations of zai-org/GLM-4.6V-Flash.
All-time downloads
5.3K
Public
Repo size
107 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf87.8 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- gguf
- License
- mit
- Access
- Public
- Created
- Dec 8, 2025
- Updated
- Apr 22, 2026
- SHA
- e6468060
Base models
Model card
From the Hugging Face model README
GLM-4.6V-Flash-GGUF
This repository contains GGUF format quantizations of zai-org/GLM-4.6V-Flash.
Model Introduction
GLM-4.6V-Flash is a lightweight multimodal model (9B parameters) optimized for local deployment and low-latency applications, part of the GLM-V family. It features a 128k context window and achieves state-of-the-art performance in visual understanding among models of similar scale.
Key features include:
- 9B Parameters (MoE): Optimized for efficiency.
- Native Multimodal Function Calling: Can process images/screenshots directly as tool inputs.
- Interleaved Image-Text Generation: Supports complex multimodal contexts.
- Document Understanding: Processes up to 128K tokens of multi-document inputs.
Usage
Note: This model uses the Glm4vMoe architecture. Please ensure you are using the latest version of llama.cpp to ensure compatibility.
Example with llama.cpp
./llama-cli -m GLM-4.6V-Flash-Q4_K_M.gguf --mmproj GLM-4.6V-Flash-mmproj-model-f16.gguf -p "Describe this image" --image your_image.jpg
- Task
- Image-Text-to-Text
- Library
- gguf
- License
- mit
- Languages
- zh, en
- Created
- Dec 8, 2025
- Updated
- Apr 22, 2026