Downloads · 30 days
134
9% of all-time downloads
RichardErkhov/KnutJaegersberg_-_Deita-2b-gguf
KnutJaegersberg_-_Deita-2b-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
134
9% of all-time downloads
All-time downloads
1.5K
Public
Repo size
36.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf41.9 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Deita-2b - GGUF
| Name | Quant method | Size |
|---|---|---|
| Deita-2b.Q2_K.gguf | Q2_K | 1.21GB |
| Deita-2b.IQ3_XS.gguf | IQ3_XS | 1.32GB |
| Deita-2b.IQ3_S.gguf | IQ3_S | 1.38GB |
| Deita-2b.Q3_K_S.gguf | Q3_K_S | 1.38GB |
| Deita-2b.IQ3_M.gguf | IQ3_M | 1.44GB |
| Deita-2b.Q3_K.gguf | Q3_K | 1.49GB |
| Deita-2b.Q3_K_M.gguf | Q3_K_M | 1.49GB |
| Deita-2b.Q3_K_L.gguf | Q3_K_L | 1.57GB |
| Deita-2b.IQ4_XS.gguf | IQ4_XS | 1.59GB |
| Deita-2b.Q4_0.gguf | Q4_0 | 1.65GB |
| Deita-2b.IQ4_NL.gguf | IQ4_NL | 1.66GB |
| Deita-2b.Q4_K_S.gguf | Q4_K_S | 1.71GB |
| Deita-2b.Q4_K.gguf | Q4_K | 1.83GB |
| Deita-2b.Q4_K_M.gguf | Q4_K_M | 1.83GB |
| Deita-2b.Q4_1.gguf | Q4_1 | 1.81GB |
| Deita-2b.Q5_0.gguf | Q5_0 | 1.96GB |
| Deita-2b.Q5_K_S.gguf | Q5_K_S | 1.99GB |
| Deita-2b.Q5_K.gguf | Q5_K | 2.09GB |
| Deita-2b.Q5_K_M.gguf | Q5_K_M | 2.09GB |
| Deita-2b.Q5_1.gguf | Q5_1 | 2.12GB |
| Deita-2b.Q6_K.gguf | Q6_K | 2.42GB |
| Deita-2b.Q8_0.gguf | Q8_0 | 2.98GB |
license: other license_name: general-model-license license_link: https://github.com/OpenBMB/General-Model-License/blob/main/%E9%80%9A%E7%94%A8%E6%A8%A1%E5%9E%8B%E8%AE%B8%E5%8F%AF%E5%8D%8F%E8%AE%AE-%E6%9D%A5%E6%BA%90%E8%AF%B4%E6%98%8E-%E5%AE%A3%E4%BC%A0%E9%99%90%E5%88%B6-%E5%95%86%E4%B8%9A%E6%8E%88%E6%9D%83.md model-index:
Prompt Example:
### System:
You are an AI assistant. User will give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.
### User:
How do you fine tune a large language model?
### Assistant:
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 52.35 |
| AI2 Reasoning Challenge (25-Shot) | 44.71 |
| HellaSwag (10-Shot) | 70.39 |
| MMLU (5-Shot) | 52.79 |
| TruthfulQA (0-shot) | 39.61 |
| Winogrande (5-shot) | 65.27 |
| GSM8k (5-shot) | 41.32 |