Downloads · 30 days
60
0% of all-time downloads
llama2_7b_merge_orcafamily
yeen214/llama2_7b_merge_orcafamily
llama2_7b_merge_orcafamily is a text generation model from yeen214. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is based on the LLama 7b model as a backbone, and datasets from various Orcas have been fine-tuned and merged.
All-time downloads
37.4K
Public
Parameters
6.7B
13.5 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Nov 20, 2023
- Updated
- Nov 20, 2023
- SHA
- fb65f697
Try a prompt
Model card
From the Hugging Face model README
This model is based on the LLama 7b model as a backbone, and datasets from various Orcas have been fine-tuned and merged.
The three models were combined, and the model with the best ARC and MMLU performance was given the highest weight.
First: fine-tuning beaugogh/openorca-multiplechoice-10k on llama2 7b, but using the NEFTune method.
Second: model fine-tuned with the SlimOrca dataset on llama2 7b.
Third : Model with beaugogh/openorca-multiplechoice-10k fine-tuned on llama2 7b.
We'll add the results once we have the official results
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Nov 20, 2023
- Updated
- Nov 20, 2023