Downloads · 30 days
79
6% of all-time downloads
matrixportalx/TurkLlama-Mix-GGUF
TurkLlama-Mix-GGUF is a machine learning model from matrixportalx. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
- Quantization Tool: llama.cpp - Version: version: 5106 (47ba87d0)
Downloads · 30 days
79
6% of all-time downloads
All-time downloads
1.4K
Public
Repo size
19.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf19.3 GB · 100%
From the Hugging Face model README
| 🚀 Download | 🔢 Type | 📝 Description |
|---|---|---|
| Download | Q3 K M | Small, acceptable quality |
| Download | Q4 0 | Standard 4-bit (fast on ARM) |
| Download | Q4 K M | 4-bit balanced (recommended default) |
| Download | Q5 K M | 5-bit best (recommended HQ option) |
💡 Q4 K M provides the best balance for most use cases