Downloads · 30 days
71.7K
76% of all-time downloads
Qwen3-VL-8B-Instruct-quantized.w4a16
SherlockID365/Qwen3-VL-8B-Instruct-quantized.w4a16
Qwen3-VL-8B-Instruct-quantized.w4a16 is a image-text-to-text model from SherlockID365. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
code taken from : https://github.com/vllm-project/llm-compressor/blob/main/examples/awq/qwen3-vl-30b-a3b-Instruct-example.py
All-time downloads
94.6K
Public
Parameters
2.7B
7.2 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors7.2 GB · 100%
Parameter types
How the weights are stored.
I326.9B · 79%
Try a prompt
Base models
Model card
From the Hugging Face model README
code taken from : https://github.com/vllm-project/llm-compressor/blob/main/examples/awq/qwen3-vl-30b-a3b-Instruct-example.py
Qwen3-VL-8B-Instruct-AWQ
AWQ (W4A16) quantized version of Qwen/Qwen3-VL-8B-Instruct.
- Quantization: AWQ, 4 bits, group_size=128, zero_point=true, version="gemm"
- modules_to_not_convert: ["visual"]
- Prepared with LLM Compressor oneshot AWQ. recipe = AWQModifier( targets="Linear", scheme="W4A16", ignore=[r"re:model.visual.", r"re:visual."], # drop lm_head from ignore duo_scaling=True, )
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_vl
- License
- apache-2.0
- Created
- Nov 3, 2025
- Updated
- Nov 3, 2025