Downloads · 30 days
78
1% of all-time downloads
KnutJaegersberg/Deita-20b
Deita-20b is a text generation model from KnutJaegersberg. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Open Source License The code is licensed under Apache-2.0, while model weights are fully open for academic research and also allow free commercial usage. To apply for a commercial license, please fill in the applicati…
Downloads · 30 days
78
1% of all-time downloads
All-time downloads
12.8K
Public
Parameters
19.9B
39.7 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors39.7 GB · 100%
From the Hugging Face model README
Open Source License The code is licensed under Apache-2.0, while model weights are fully open for academic research and also allow free commercial usage. To apply for a commercial license, please fill in the application form (English)/申请表(中文). For other questions or collaborations, please contact [email protected].
Prompt Example:
### System:
You are an AI assistant. User will give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.
### User:
How do you fine tune a large language model?
### Assistant:
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 71.40 |
| AI2 Reasoning Challenge (25-Shot) | 63.91 |
| HellaSwag (10-Shot) | 83.11 |
| MMLU (5-Shot) | 67.40 |
| TruthfulQA (0-shot) | 57.29 |
| Winogrande (5-shot) | 84.61 |
| GSM8k (5-shot) | 72.10 |