Downloads · 30 days
157
0% of all-time downloads
btbtyler09/Qwen3-Coder-30B-A3B-Instruct-gptq-4bit
Qwen3-Coder-30B-A3B-Instruct-gptq-4bit is a text generation model from btbtyler09. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
157
0% of all-time downloads
All-time downloads
145K
Public
Parameters
30.5B
18.7 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors18.7 GB · 100%
How the weights are stored.
I3229.9B · 98%
From the Hugging Face model README
Quantized using GPTQModel
quantiziation config:
quant_config = QuantizeConfig(
bits=4,
group_size=32,
sym=True,
desc_act=False,
true_sequential=True,
pack_dtype=torch.int32,
damp_percent=0.1
)