Downloads · 30 days
56
0% of all-time downloads
Brillibits/Instruct_Llama70B_Dolly15k
Instruct_Llama70B_Dolly15k is a text generation model from Brillibits. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Fine-tuned from Llama-2-70B,used Dolly15k for the dataset. 80% for training, 15% validation, 5% test. Trained for 1.5 epochs using QLora. Trained with 1024 context window.
Downloads · 30 days
56
0% of all-time downloads
All-time downloads
69K
Public
Repo size
276 GB
Likes
1
Public
Click a slice to open those files.
.bin138 GB · 50%
From the Hugging Face model README
Fine-tuned from Llama-2-70B,used Dolly15k for the dataset. 80% for training, 15% validation, 5% test. Trained for 1.5 epochs using QLora. Trained with 1024 context window.
Write a 10-line poem about a given topic
Input:
The topic is about racecars
Output:
Who was the was the second president of the United States?
Output:
This model and other models like it are great, but where LLMs hold the most promise is when they are applied on custom data to automate a wide variety of tasks
If you have a dataset and want to see if you might be able to apply that data to automate some tasks, and you are looking for professional assistance, contact me here
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 60.97 |
| ARC (25-shot) | 68.34 |
| HellaSwag (10-shot) | 87.21 |
| MMLU (5-shot) | 69.52 |
| TruthfulQA (0-shot) | 46.46 |
| Winogrande (5-shot) | 84.29 |
| GSM8K (5-shot) | 42.68 |
| DROP (3-shot) | 28.26 |