Downloads · 30 days
96
7% of all-time downloads
RichardErkhov/yeen214_-_llama2_7b_merge_orcafamily-gguf
yeen214_-_llama2_7b_merge_orcafamily-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
96
7% of all-time downloads
All-time downloads
1.4K
Public
Repo size
76.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf88.7 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
llama2_7b_merge_orcafamily - GGUF
license: mit datasets:
This model is based on the LLama 7b model as a backbone, and datasets from various Orcas have been fine-tuned and merged.
The three models were combined, and the model with the best ARC and MMLU performance was given the highest weight.
First: fine-tuning beaugogh/openorca-multiplechoice-10k on llama2 7b, but using the NEFTune method.
Second: model fine-tuned with the SlimOrca dataset on llama2 7b.
Third : Model with beaugogh/openorca-multiplechoice-10k fine-tuned on llama2 7b.
We'll add the results once we have the official results