Downloads · 30 days
10
19% of all-time downloads
LoneStriker/MixTAO-7Bx2-MoE-v8.1-8.0bpw-h8-exl2
MixTAO-7Bx2-MoE-v8.1-8.0bpw-h8-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
MixTAO-7Bx2-MoE is a Mixure of Experts (MoE). This model is mainly used for large model technology experiments, and increasingly perfect iterations will eventually create high-level large language models. Detailed res…
Downloads · 30 days
10
19% of all-time downloads
All-time downloads
52
Public
Repo size
13 GB
Likes
0
Public
Click a slice to open those files.
.safetensors13 GB · 100%
From the Hugging Face model README
MixTAO-7Bx2-MoE is a Mixure of Experts (MoE). This model is mainly used for large model technology experiments, and increasingly perfect iterations will eventually create high-level large language models.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 77.50 |
| AI2 Reasoning Challenge (25-Shot) | 73.81 |
| HellaSwag (10-Shot) | 89.22 |
| MMLU (5-Shot) | 64.92 |
| TruthfulQA (0-shot) | 78.57 |
| Winogrande (5-shot) | 87.37 |
| GSM8k (5-shot) | 71.11 |