Downloads · 30 days
4
7% of all-time downloads
divpasta123/Qwen2.5-14B-Instruct-1M-AWQ
Qwen2.5-14B-Instruct-1M-AWQ is a machine learning model from divpasta123. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized from Qwen/Qwen2.5-14B-Instruct-1M down to 4 bits, GEMM.
Downloads · 30 days
4
7% of all-time downloads
All-time downloads
54
Public
Parameters
14.8B
10 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors10 GB · 100%
How the weights are stored.
I3213.2B · 89%
From the Hugging Face model README
Quantized from Qwen/Qwen2.5-14B-Instruct-1M down to 4 bits, GEMM.