Downloads · 30 days
25
12% of all-time downloads
ervin0307/LightOnOCR-2-1B-GGUF
LightOnOCR-2-1B-GGUF is a machine learning model from ervin0307. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This are the quantizations of the model LightOnOCR-2-1B Try to use the best quality you can run. Quality order: BF16 F16 Q80 Q6K Q5KM IQ4NL IQ4XS Q4KM For the mmproj, try to use the F32 version as it will produce the…
Downloads · 30 days
25
12% of all-time downloads
All-time downloads
212
Public
Repo size
2.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.9 GB · 100%
From the Hugging Face model README
This are the quantizations of the model LightOnOCR-2-1B Try to use the best quality you can run. Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M For the mmproj, try to use the F32 version as it will produce the best results. Quality order: F32 > BF16 > F16