Downloads · 30 days
351
6% of all-time downloads
ikawrakow/qwen-14b-chat-gguf
qwen-14b-chat-gguf is a machine learning model from ikawrakow. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Posting these Qwen-14B-Chat quantized models in GGUF format for use with llama.cpp due to a user request.
Downloads · 30 days
351
6% of all-time downloads
All-time downloads
6.1K
Public
Repo size
43.8 GB
Likes
5
Public
Click a slice to open those files.
.gguf43.8 GB · 100%
From the Hugging Face model README
Posting these Qwen-14B-Chat quantized models in GGUF format for use with llama.cpp due to a user request.
But, having used an importance matrix derived from English-only training data in the quantization, I have no idea how these models will perform in Chinese.