Downloads · 30 days
55
0% of all-time downloads
itsliupeng/llama2_7b_mmlu
llama2_7b_mmlu is a text generation model from itsliupeng. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
We are utilizing the mmlurecall dataset to continuously train the Llama-2-7b-hf model, aiming to enhance performance on mmlu metrics, while ensuring that other metric performances remain unaffected.
Downloads · 30 days
55
0% of all-time downloads
All-time downloads
43.7K
Public
Repo size
27 GB
Likes
7
Public
Click a slice to open those files.
.bin13.5 GB · 100%
From the Hugging Face model README
We are utilizing the mmlu_recall dataset to continuously train the Llama-2-7b-hf model, aiming to enhance performance on mmlu metrics, while ensuring that other metric performances remain unaffected.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 46.31 |
| ARC (25-shot) | 56.14 |
| HellaSwag (10-shot) | 79.13 |
| MMLU (5-shot) | 60.04 |
| TruthfulQA (0-shot) | 40.95 |
| Winogrande (5-shot) | 74.43 |
| GSM8K (5-shot) | 7.88 |
| DROP (3-shot) | 5.59 |