Downloads · 30 days
1.1K
6% of all-time downloads
Qianfan-OCR-GGUF
Reza2kn/Qianfan-OCR-GGUF
Qianfan-OCR-GGUF is a image-text-to-text model from Reza2kn. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
GGUF quantizations of baidu/Qianfan-OCR.
All-time downloads
20.4K
Public
Repo size
38.1 GB
Likes
17
Public
Repo makeup
Click a slice to open those files.
.gguf38.1 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- llama.cpp
- License
- apache-2.0
- Access
- Public
- Created
- Mar 19, 2026
- Updated
- Sep 9, 2026
- SHA
- c85ede08
Base models
Model card
From the Hugging Face model README
Qianfan-OCR — GGUF Quantizations
GGUF quantizations of baidu/Qianfan-OCR.
Original model: InternVL Chat architecture with Qwen3 LLM backbone (~4.7B params). Quantized by Reza2kn using llama.cpp.
Files
| Filename | Quant | Size | Quality |
|---|---|---|---|
Qianfan-OCR-f16.gguf | F16 | ~9.4 GB | Lossless (half precision) |
Qianfan-OCR-q8_0.gguf | Q8_0 | ~5.0 GB | Near-lossless |
Qianfan-OCR-q6_k.gguf | Q6_K | ~3.8 GB | Excellent |
Qianfan-OCR-q5_k_m.gguf | Q5_K_M | ~3.3 GB | Very good |
Qianfan-OCR-q5_k_s.gguf | Q5_K_S | ~3.2 GB | Very good |
Qianfan-OCR-q4_k_m.gguf | Q4_K_M | ~2.8 GB | Good (recommended) |
Qianfan-OCR-q4_k_s.gguf | Q4_K_S | ~2.7 GB | Good |
Qianfan-OCR-q4_0.gguf | Q4_0 | ~2.6 GB | Legacy 4-bit |
Qianfan-OCR-q3_k_m.gguf | Q3_K_M | ~2.2 GB | Moderate |
Qianfan-OCR-q3_k_s.gguf | Q3_K_S | ~2.1 GB | Moderate |
Qianfan-OCR-q2_k.gguf | Q2_K | ~1.7 GB | Low quality |
Usage (llama.cpp)
llama-cli -m Qianfan-OCR-q4_k_m.gguf --mmproj Qianfan-OCR-mmproj.gguf \
--image document.jpg -p "Please OCR this document."
Original Model
See baidu/Qianfan-OCR for full documentation, benchmarks (OmniDocBench 93.12, OCRBench 880), and usage examples.
Licensing and attribution
This model distribution is licensed under the Apache License, Version 2.0. See LICENSE. Existing third-party copyright, license, and attribution notices remain applicable.
- Upstream: baidu/Qianfan-OCR; declared license:
apache-2.0.
- Task
- Image-Text-to-Text
- Library
- llama.cpp
- License
- apache-2.0
- Languages
- multilingual
- Created
- Mar 19, 2026
- Updated
- Sep 9, 2026