Downloads · 30 days
55
13% of all-time downloads
cstr/olmOCR-2-7B-1025-GGUF
olmOCR-2-7B-1025-GGUF is a machine learning model from cstr. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF conversion of allenai/olmOCR-2-7B-1025 (Apache-2.0, a Qwen2.5-VL-7B document-OCR fine-tune) for the CrispEmbed native runtime.
Downloads · 30 days
55
13% of all-time downloads
All-time downloads
409
Public
Repo size
14.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf14.7 GB · 100%
From the Hugging Face model README
GGUF conversion of allenai/olmOCR-2-7B-1025 (Apache-2.0, a Qwen2.5-VL-7B document-OCR fine-tune) for the CrispEmbed native runtime.
| file | quant | size | notes |
|---|---|---|---|
olmocr-2-7b-q8_0.gguf | Q8_0 | 8.4 GiB | norms/bias/embeddings F32 |
olmocr-2-7b-q4_k.gguf | Q4_K | 5.3 GiB | vision kept at Q8_0 floor |
Converted with models/convert-qwen2vl-to-gguf.py (F16 intermediate) and
crispembed-quantize.
crispembed --ocr-pipeline page.png --ocr-engine olmocr
The runtime auto-detects the olmOCR contract from the model name: the exact
no-anchoring fine-tune prompt, text-before-image user turn, longest-side-1288
input scaling, and 8000-token output budget. The model answers in markdown
with a YAML front-matter block (language / rotation / table / diagram flags);
CrispEmbed strips it by default (CRISPEMBED_OLMOCR_RAW=1 keeps the raw
output).
All model weights derive from allenai/olmOCR-2-7B-1025 (Ai2), Apache-2.0.
See the upstream model card for training details and the olmOCR toolkit.