Downloads · 30 days
8
8% of all-time downloads
Qwen3-14B-HQQ-INT4
drawais/Qwen3-14B-HQQ-INT4
Qwen3-14B-HQQ-INT4 is a text generation model from drawais. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
INT4 quantization of Qwen/Qwen3-14B. Calibration-free companion to drawais/Qwen3-14B-AWQ-INT4.
All-time downloads
98
Public
Repo size
10.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt10.1 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Apr 27, 2026
- Updated
- Apr 28, 2026
- SHA
- 945820d3
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-14B-HQQ-INT4
INT4 quantization of Qwen/Qwen3-14B. Calibration-free companion to drawais/Qwen3-14B-AWQ-INT4.
Footprint
| Source params | 14B |
| Quantized weights | ~9.5 GB on disk |
| Inference VRAM (incl. KV cache @ 32K context) | ~16 GB |
Recommended use
Best at native 40K context. This release is intended for chat / interactive workloads at the base model's native context length.
For long-context (>40K) use the AWQ companion — drawais/Qwen3-14B-AWQ-INT4, which scored 90% overall on needle-1M-bench-mvp 50K with YaRN extension via vLLM.
Bench
The companion AWQ release scored 90.0% overall (paper-anchored 80%, synthetic 100%) on drawais/needle-1M-bench-mvp 50K with YaRN-extended context via vLLM. A direct HQQ score at native ≤40K context is queued for a future release.
Quick start
from transformers import AutoTokenizer
from hqq.models.hf.base import AutoHQQHFModel
tok = AutoTokenizer.from_pretrained("drawais/Qwen3-14B-HQQ-INT4")
model = AutoHQQHFModel.from_quantized("drawais/Qwen3-14B-HQQ-INT4", device="cuda")
License
Apache 2.0 (inherits from base model).
- Task
- Text Generation
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Apr 27, 2026
- Updated
- Apr 28, 2026