Downloads · 30 days
20
11% of all-time downloads
mikoy92/Unlimited-OCR-4bit-mlx
Unlimited-OCR-4bit-mlx is a image-text-to-text model from mikoy92. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as mit.
This is a 4-bit affine MLX quantization of mikoy92/Unlimited-OCR-bf16-mlx, converted with mlx-vlm.
Downloads · 30 days
20
11% of all-time downloads
All-time downloads
180
Public
Parameters
3.3B
2.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.5 GB · 100%
How the weights are stored.
U322.9B · 88%
From the Hugging Face model README
This is a 4-bit affine MLX quantization of mikoy92/Unlimited-OCR-bf16-mlx, converted with mlx-vlm.
Quantization settings:
affine4645.883Because this is a vision-language OCR model, mlx-vlm does not aggressively quantize every multimodal tensor; the effective bits-per-weight can be higher than exactly 4-bit.
pip install -U mlx-vlm
mlx_vlm.generate \
--model mikoy92/Unlimited-OCR-4bit-mlx \
--image /path/to/image.png \
--prompt "Extract all readable text from this image." \
--max-tokens 512 \
--temperature 0
Before upload, this checkpoint was loaded locally with mlx_vlm.generate and produced OCR text/table output on a document-image smoke test.