surya-ocr-2-mlx-4bit-g64

Surya OCR 2 MLX 4-bit G64 Experimental

This repository contains an **experimental quantized** artifact derived from [datalab-to/surya-ocr-2](https://huggingface.co/datalab-to/surya-ocr-2).

This is the smallest currently published Surya OCR 2 artifact from the batch. It is useful as an experimental size floor: it stays perfect on headers/footers, multi-column, tables, and baseline checks, but it is not suitable for math-heavy OCR, old scans, or long tiny text yet.

## What is included

- Source model: `datalab-to/surya-ocr-2`
- Runtime/format: MLX / mlx-vlm
- Quantization: 4-bit affine weight quantization, group size 64
- Vision weights included: Yes. The MLX checkpoint includes the model vision weights and processor assets.
- Processor/tokenizer assets: included

## Mini olmOCR-bench results

| Candidate | Overall | Arxiv math | Headers/footers | Long tiny text | Multi-column | Old scans | Old scans math | Tables | Baseline |

|---|---:|---:|---:|---:|---:|---:|---:|---:|---:| | Source mini baseline | 91.0% ± 6.3% | 100.0% | 100.0% | 100.0% | 100.0% | 33.3% | 100.0% | 100.0% | 94.7% | | Surya OCR 2 MLX 4-bit G64 Experimental | 70.8% ± 12.5% | 66.7% | 100.0% | 33.3% | 100.0% | 0.0% | 66.7% | 100.0% | 100.0% |

How to read the benchmark table

This is an early quant release with transparent limitations. The table uses our local 40-test mini slice of allenai/olmOCR-bench, with 3 samples from each named section plus the benchmark baseline checks. It is not the full public score and it is not a claim of >98% parity.

The useful signal is the split behavior: this artifact is currently strong on clean academic/math, headers/footers, multi-column layouts, tables, old-scan math, and baseline OCR checks, but it should not be used for old degraded scans and is weak on long tiny text.

Recommended use

Use this checkpoint for local experimentation and constrained OCR workloads whose documents resemble the passing sections above. Avoid using it as a production replacement for the original model on degraded historical scans, very small dense body text, or workloads requiring full benchmark parity.

## Loading

```python

from mlx_vlm import load, generate

model, processor = load("Reza2kn/surya-ocr-2-mlx-4bit-g64")

Treat as an experimental compact checkpoint; validate on your document type first.

    ## Limitations

    - This is not a full-parity release yet.
    - Do **not** use this artifact for degraded old scans; the current mini split score is 0.0% there.
    - Do **not** use this artifact for long tiny text unless you independently validate your data; the current mini split score is 33.3%.
    - MLX 4-bit specifically should not be used for math-heavy OCR until further calibration improves arxiv math and old-scans-math behavior.

    ## Provenance

    Generated non-destructively from the original Hugging Face checkpoint. This is not a fine-tune. The goal of publishing this artifact now is transparency: the files are usable for the passing workload slices above, and the known failing slices are documented clearly.