Downloads · 30 days
104
4% of all-time downloads
ddh0/Qwen2.5-14B-All-Variants-q8_0-q6_K-GGUF
Qwen2.5-14B-All-Variants-q8_0-q6_K-GGUF is a machine learning model from ddh0. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repo contains GGUF quantizations of Qwen/Qwen2.5-14B, Qwen/Qwen2.5-14B-Instruct, and Qwen/Qwen2.5-Coder-14B-Instruct models at q6K, using q80 for output and embedding tensors.
Downloads · 30 days
104
4% of all-time downloads
All-time downloads
2.7K
Public
Repo size
100 GB
Likes
2
Public
Click a slice to open those files.
.gguf75 GB · 100%
From the Hugging Face model README
This repo contains GGUF quantizations of Qwen/Qwen2.5-14B, Qwen/Qwen2.5-14B-Instruct, and Qwen/Qwen2.5-Coder-14B-Instruct models at q6_K, using q8_0 for output and embedding tensors.