Downloads · 30 days
22
15% of all-time downloads
ProCreations/grug-v1.1-qwen-3.8-27b-awq-int4
grug-v1.1-qwen-3.8-27b-awq-int4 is a image-text-to-text model from ProCreations. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
vLLM-oriented quantization of ProCreations/grug-v1.1-qwen-3.8-27b, pinned to revision 3ab073b4bb06dc8a83e819a33485469f32b945ba. Activation-aware W4A16 asymmetric INT4 with group size 128, calibrated on 128 Ultrachat s…
Downloads · 30 days
22
15% of all-time downloads
All-time downloads
149
Public
Parameters
5.8B
18.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors18.7 GB · 100%
How the weights are stored.
I3224.3B · 89%
From the Hugging Face model README
vLLM-oriented quantization of ProCreations/grug-v1.1-qwen-3.8-27b, pinned to
revision 3ab073b4bb06dc8a83e819a33485469f32b945ba. Activation-aware W4A16 asymmetric INT4 with group size 128, calibrated on 128 Ultrachat samples at 1024 tokens. The vision tower, embeddings, LM head, GatedDeltaNet a/b gates, and MTP namespace remain BF16.
The trained MTP head is not included in this repository. Use the corresponding -mtp-...
repository for speculative decoding.
vllm serve ProCreations/grug-v1.1-qwen-3.8-27b-awq-int4 --max-model-len 32768 \
--reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder
The exact build script and structural report are included under reproduce/ and
quantization_report.json.