Downloads · 30 days
20
8% of all-time downloads
Qwen2.5-14B-Instruct-GGUF
Limour/Qwen2.5-14B-Instruct-GGUF
Qwen2.5-14B-Instruct-GGUF is a machine learning model from Limour. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
https://www.kaggle.com/code/reginliu/qwen2-5-gguf-imatrix
All-time downloads
243
Public
Repo size
8.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf8.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Nov 9, 2024
- Updated
- Nov 9, 2024
- SHA
- 10deddaa
Model card
From the Hugging Face model README
https://www.kaggle.com/code/reginliu/qwen2-5-gguf-imatrix
| Model | Size | PPL | n_vocab | PPL_adjust |
|---|---|---|---|---|
| qwen2.5-14b-fp16.gguf | 27.51 | 9.5316 +/- 0.08886 | 152064 | 9.5316 |
| qwen2.5-14b-IQ4_XS.gguf | 7.56 | 9.6508 +/- 0.09039 | 152064 | 9.6508 |
- License
- apache-2.0
- Created
- Nov 9, 2024
- Updated
- Nov 9, 2024