Downloads · 30 days
32
37% of all-time downloads
ISTA-DASLab/Qwen3-8B-MatGPTQ
Qwen3-8B-MatGPTQ is a text generation model from ISTA-DASLab. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is the official MatGPTQ checkpoint of Qwen/Qwen3-8B, produced as described in the "MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization" paper.
Downloads · 30 days
32
37% of all-time downloads
All-time downloads
86
Public
Parameters
8.3B
19.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.7 GB · 100%
How the weights are stored.
U86.9B · 84%
From the Hugging Face model README
This is the official MatGPTQ checkpoint of Qwen/Qwen3-8B, produced as described in the "MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization" paper.
This model can be run via vLLM. Checkout our integration at IST-DASLab/MatGPTQ