Downloads · 30 days
41
11% of all-time downloads
vlm_ocr_gguf
TraiNC/vlm_ocr_gguf
vlm_ocr_gguf is a machine learning model from TraiNC. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF Q80 quantized version of TraiNC/vlmocrlora.
All-time downloads
369
Public
Repo size
2.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.6 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jul 7, 2026
- Updated
- Jul 7, 2026
- SHA
- 896937ee
Base models
Model card
From the Hugging Face model README
TraiNC/vlm_ocr_gguf
GGUF Q8_0 quantized version of TraiNC/vlm_ocr_lora.
Files
| File | Description | Size |
|---|---|---|
model.gguf | Text decoder (Q8_0) + vision encoder | ~795 MB |
mmproj-f16.gguf | Vision projector, F16 | ~205 MB |
Run with images
llama-mtmd-cli -m model.gguf --mmproj mmproj-f16.gguf \\
--image your_image.jpg -p "Describe this image"
| model-f16.gguf | Full precision reference (F16) | ~1.5 GB |
How to run
Text
llama-cli -m model.gguf -p "Hello" -n 256
Server (OpenAI-compatible API)
llama-server -m model.gguf --host 0.0.0.0 --port 8080
Notes
- Q8_0 applied to weight tensors; embeddings and norms stay at higher precision.
- Built with llama.cpp.
- License
- apache-2.0
- Created
- Jul 7, 2026
- Updated
- Jul 7, 2026