Downloads · 30 days
51
17% of all-time downloads
RichardErkhov/KnutJaegersberg_-_Deita-20b-gguf
KnutJaegersberg_-_Deita-20b-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
51
17% of all-time downloads
All-time downloads
309
Public
Repo size
201 GB
Likes
0
Public
Click a slice to open those files.
.gguf227 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Deita-20b - GGUF
| Name | Quant method | Size |
|---|---|---|
| Deita-20b.Q2_K.gguf | Q2_K | 7.03GB |
| Deita-20b.Q3_K_S.gguf | Q3_K_S | 8.16GB |
| Deita-20b.Q3_K.gguf | Q3_K | 3.45GB |
| Deita-20b.Q3_K_M.gguf | Q3_K_M | 9.05GB |
| Deita-20b.Q3_K_L.gguf | Q3_K_L | 9.83GB |
| Deita-20b.IQ4_XS.gguf | IQ4_XS | 10.12GB |
| Deita-20b.Q4_0.gguf | Q4_0 | 9.55GB |
| Deita-20b.IQ4_NL.gguf | IQ4_NL | 9.36GB |
| Deita-20b.Q4_K_S.gguf | Q4_K_S | 10.62GB |
| Deita-20b.Q4_K.gguf | Q4_K | 11.16GB |
| Deita-20b.Q4_K_M.gguf | Q4_K_M | 11.16GB |
| Deita-20b.Q4_1.gguf | Q4_1 | 11.67GB |
| Deita-20b.Q5_0.gguf | Q5_0 | 12.79GB |
| Deita-20b.Q5_K_S.gguf | Q5_K_S | 12.79GB |
| Deita-20b.Q5_K.gguf | Q5_K | 13.11GB |
| Deita-20b.Q5_K_M.gguf | Q5_K_M | 13.11GB |
| Deita-20b.Q5_1.gguf | Q5_1 | 13.91GB |
| Deita-20b.Q6_K.gguf | Q6_K | 15.18GB |
| Deita-20b.Q8_0.gguf | Q8_0 | 19.66GB |
license: other datasets:
Open Source License The code is licensed under Apache-2.0, while model weights are fully open for academic research and also allow free commercial usage. To apply for a commercial license, please fill in the application form (English)/申请表(中文). For other questions or collaborations, please contact [email protected].
Prompt Example:
### System:
You are an AI assistant. User will give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.
### User:
How do you fine tune a large language model?
### Assistant:
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 71.40 |
| AI2 Reasoning Challenge (25-Shot) | 63.91 |
| HellaSwag (10-Shot) | 83.11 |
| MMLU (5-Shot) | 67.40 |
| TruthfulQA (0-shot) | 57.29 |
| Winogrande (5-shot) | 84.61 |
| GSM8k (5-shot) | 72.10 |