Downloads · 30 days
15
8% of all-time downloads
pszemraj/nougat-small-onnx-quant_avx512_vnni
nougat-small-onnx-quant_avx512_vnni is a image-text-to-text model from pszemraj. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This was quantized from pszemraj/nougat-small-onnx using the --avx512vnni flag. You need to have a processor with avx512vnni instructions for this to work properly.
Downloads · 30 days
15
8% of all-time downloads
All-time downloads
199
Public
Repo size
422 MB
Likes
0
Public
Click a slice to open those files.
.onnx422 MB · 99%
From the Hugging Face model README
This was quantized from pszemraj/nougat-small-onnx using the --avx512_vnni flag. You need to have a processor with avx512_vnni instructions for this to work properly.
per_channel is set to True for better accuracylscpu | grep avx512_vnni