Downloads · 30 days
20
8% of all-time downloads
mikoy92/Unlimited-OCR-8bit-mlx
Unlimited-OCR-8bit-mlx is a image-text-to-text model from mikoy92. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as mit.
This is an 8-bit affine MLX quantization of mikoy92/Unlimited-OCR-bf16-mlx, converted with mlx-vlm.
Downloads · 30 days
20
8% of all-time downloads
All-time downloads
259
Public
Parameters
3.3B
3.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.9 GB · 100%
How the weights are stored.
U322.9B · 88%
From the Hugging Face model README
This is an 8-bit affine MLX quantization of mikoy92/Unlimited-OCR-bf16-mlx, converted with mlx-vlm.
Quantization settings:
affine8649.408Because this is a vision-language OCR model, mlx-vlm does not aggressively quantize every multimodal tensor; the effective bits-per-weight can be higher than exactly 8-bit.
pip install -U mlx-vlm
mlx_vlm.generate \
--model mikoy92/Unlimited-OCR-8bit-mlx \
--image /path/to/image.png \
--prompt "Extract all readable text from this image." \
--max-tokens 512 \
--temperature 0
Before upload, this checkpoint was loaded locally with mlx_vlm.generate and produced OCR text/table output on a document-image smoke test.