Downloads · 30 days
55
0% of all-time downloads
itsliupeng/llama2_70b_mmlu
llama2_70b_mmlu is a text generation model from itsliupeng. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
We are utilizing the mmlurecall dataset to continuously train the Llama-2-70b-hf model, aiming to enhance performance on mmlu metrics, while ensuring that other metric performances remain unaffected.
Downloads · 30 days
55
0% of all-time downloads
All-time downloads
26.2K
Public
Parameters
69B
138 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors138 GB · 100%
From the Hugging Face model README
We are utilizing the mmlu_recall dataset to continuously train the Llama-2-70b-hf model, aiming to enhance performance on mmlu metrics, while ensuring that other metric performances remain unaffected.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 68.24 |
| AI2 Reasoning Challenge (25-Shot) | 65.61 |
| HellaSwag (10-Shot) | 87.37 |
| MMLU (5-Shot) | 71.89 |
| TruthfulQA (0-shot) | 49.15 |
| Winogrande (5-shot) | 82.40 |
| GSM8k (5-shot) | 52.99 |