Downloads · 30 days
73
6% of all-time downloads
Nekotekina/Qwen1.5-14B-Chat-GGUF-F32
Qwen1.5-14B-Chat-GGUF-F32 is a machine learning model from Nekotekina. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Made directly from https://huggingface.co/Qwen/Qwen1.5-14B-Chat I think official GGUF was made from already compressed AWQ. I converted original model to f32 first instead. Results are subjectively slightly better tha…
Downloads · 30 days
73
6% of all-time downloads
All-time downloads
1.3K
Public
Repo size
39.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf39.5 GB · 100%
From the Hugging Face model README
Made directly from https://huggingface.co/Qwen/Qwen1.5-14B-Chat I think official GGUF was made from already compressed AWQ. I converted original model to f32 first instead. Results are subjectively slightly better than official GGUF. But I didn't perform any perplexity test.