Downloads · 30 days
107
45% of all-time downloads
kaitchup/Qwen3-VL-2B-Instruct-W4A16
Qwen3-VL-2B-Instruct-W4A16 is a machine learning model from kaitchup. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is Qwen/Qwen3-VL-8B-Instruct quantized with AutoRound in W4A16 (GPTQ format). The model has been created, tested, and evaluated by The Kaitchup. The model is NOT compatible with vLLM (as of v0.11).
Downloads · 30 days
107
45% of all-time downloads
All-time downloads
239
Public
Parameters
907M
2.2 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors2.2 GB · 99%
How the weights are stored.
BF16718M · 79%
From the Hugging Face model README
This is Qwen/Qwen3-VL-8B-Instruct quantized with AutoRound in W4A16 (GPTQ format). The model has been created, tested, and evaluated by The Kaitchup. The model is NOT compatible with vLLM (as of v0.11).
Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free. Or you prefer to give some GPU hours, "buy me a coffee"