Downloads · 30 days
984
100% of all-time downloads
prithivMLmods/LensVLM-9B-GGUF
LensVLM-9B-GGUF is a image-text-to-text model from prithivMLmods. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apple-amlr.
LensVLM-9B is a 9-billion-parameter vision-language model from Apple, built on Qwen3.5-9B, introduced in the paper "LensVLM: Selective Context Expansion for Compressed Visual Representation of Text." Its core mechanis…
Downloads · 30 days
984
100% of all-time downloads
All-time downloads
984
Public
Repo size
59.5 GB
Likes
5
Public
Click a slice to open those files.
.gguf59.5 GB · 100%
From the Hugging Face model README
LensVLM-9B is a 9-billion-parameter vision-language model from Apple, built on Qwen3.5-9B, introduced in the paper "LensVLM: Selective Context Expansion for Compressed Visual Representation of Text." Its core mechanism scans a compressed image representation of text — at configurable compression ratios of 5x, 10x, or 15x — and then selectively expands only the pages relevant to a given question back to their uncompressed form via learned tools, allowing the model to process very long documents without holding the entire uncompressed text in context. It's run via the accompanying
ml-lensvlmcodebase with a simple demo script accepting a text file and a question, and is released under the Apple Machine Learning Research Model License (with the accompanying source code separately licensed under the Apple Sample Code License).
| File Name | Quant Type | File Size | File Link | Description |
|---|---|---|---|---|
| LensVLM-9B.BF16.gguf | BF16 | 17.9 GB | Link | Full BF16 weights. Highest quality, largest file size. |
| LensVLM-9B.Q3_K_L.gguf | Q3_K_L | 4.93 GB | Link | Lower quality but usable, good for low RAM availability. |
| LensVLM-9B.Q3_K_M.gguf | Q3_K_M | 4.62 GB | Link | Low quality. |
| LensVLM-9B.Q4_K_M.gguf | Q4_K_M | 5.63 GB | Link | Good quality, default size for most use cases, recommended. |
| LensVLM-9B.Q4_K_S.gguf | Q4_K_S | 5.35 GB | Link | Slightly lower quality with more space savings, recommended. |
| LensVLM-9B.Q5_K_M.gguf | Q5_K_M | 6.47 GB | Link | High quality, recommended. |
| LensVLM-9B.Q5_K_S.gguf | Q5_K_S | 6.31 GB | Link | High quality, recommended. |
| LensVLM-9B.Q6_K.gguf | Q6_K | 7.36 GB | Link | Very high quality, near perfect, recommended. |
| LensVLM-9B.mmproj-bf16.gguf | mmproj-bf16 | 922 MB | Link | Multimodal projection file in BF16 format. Used for vision/language models. |
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp