Downloads · 30 days
114
4% of all-time downloads
JinRiYao2001/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-AWQ
Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-AWQ is a machine learning model from JinRiYao2001. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository provides an AWQ-quantized version of the original huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated model.
Downloads · 30 days
114
4% of all-time downloads
All-time downloads
2.6K
Public
Parameters
5.8B
19.2 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors19.2 GB · 100%
How the weights are stored.
I3229.9B · 93%
From the Hugging Face model README
This repository provides an AWQ-quantized version of the original
huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated model.
The goal of this quantization is to reduce GPU memory usage and enable efficient inference deployment using frameworks such as vLLM.
The model was quantized using llm-compressor with a calibration dataset and standard AWQ workflow.
Key steps:
This model is intended for:
Example use cases include:
All credit for the original model goes to:
huihui-ai / Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
This repository only provides an AWQ-quantized version for inference efficiency.