Downloads · 30 days
58
0% of all-time downloads
llama2-exams-orca-sharegpt
HWERI/llama2-exams-orca-sharegpt
llama2-exams-orca-sharegpt is a text generation model from HWERI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a Llama2-7B model finetuned on the union of ShareGPT, the exams dataset and a subset of the Orca dataset. The finetuning was performed with DeepSpeed Chat toolkit (step 1, sft). The model run for three e…
All-time downloads
32.2K
Public
Repo size
27 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Oct 18, 2023
- Updated
- Oct 23, 2023
- SHA
- 0d6c33d5
Try a prompt
Model card
From the Hugging Face model README
This model is a Llama2-7B model finetuned on the union of ShareGPT, the exams dataset and a subset of the Orca dataset. The finetuning was performed with DeepSpeed Chat toolkit (step 1, sft). The model run for three epochs before reaching a plateau on the validation dataset. We used a cosine scheduler, with an initial LR of 2e-5.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en, zh, ko, ja, fr
- Created
- Oct 18, 2023
- Updated
- Oct 23, 2023