Downloads · 30 days
47
20% of all-time downloads
saital/Qwen3.5-4B-W4A16-g128-lmheadW8
Qwen3.5-4B-W4A16-g128-lmheadW8 is a image-text-to-text model from saital. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
A 4-bit weight quantization of Qwen3.5-4B (GPTQ W4A16, group size 128, compressed-tensors pack-quantized), with the lmhead untied from the embeddings and quantized to 8-bit to shrink the per-step output-projection rea…
Downloads · 30 days
47
20% of all-time downloads
All-time downloads
231
Public
Parameters
4.9B
3.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.8 GB · 99%
How the weights are stored.
I324.2B · 86%
From the Hugging Face model README
A 4-bit weight quantization of Qwen3.5-4B (GPTQ W4A16, group size 128, compressed-tensors
pack-quantized), with the lm_head untied from the embeddings and quantized to 8-bit to shrink
the per-step output-projection read. Built for fast single-request (batch-1, greedy) inference and
designed to pair with the DFlash speculative-decoding drafter.
Produced offline with llm-compressor GPTQModifier (4-bit symmetric int, group 128,
actorder: static), calibrated on 840 public, train-split samples (ARC-Challenge, QASC,
MedMCQA, MedQA-USMLE, AQuA-RAT, CommonsenseQA, Dolly). The benchmark datasets (GPQA-Diamond,
MMLU-Pro, IFEval) are explicitly excluded from calibration.
This quantization is released under Apache-2.0. The underlying base model remains subject to the Qwen3.5-4B license from the Qwen team.