Downloads · 30 days
73
0% of all-time downloads
Mixtral-8x7B-v0.1-top3
itsliupeng/Mixtral-8x7B-v0.1-top3
Mixtral-8x7B-v0.1-top3 is a text generation model from itsliupeng. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
To evaluate the impact of increasing the number of experts, modify the numexpertspertok setting in the config.json file from 2 to 3. This alteration aims to specifically determine if such a change leads to any notable…
All-time downloads
38.8K
Public
Parameters
46.7B
93.4 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Dec 18, 2023
- Updated
- Mar 7, 2024
- SHA
- e3853541
Try a prompt
Model card
From the Hugging Face model README
Just to obtain metrics from the HuggingFaceH4/open_llm_leaderboard.
To evaluate the impact of increasing the number of experts, modify the num_experts_per_tok setting in the config.json file from 2 to 3. This alteration aims to specifically determine if such a change leads to any notable improvements in performance metrics.
Other details to note include that the model weights are directly copied from the source available at https://huggingface.co/mistralai/Mixtral-8x7B-v0.1.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 69.09 |
| AI2 Reasoning Challenge (25-Shot) | 67.41 |
| HellaSwag (10-Shot) | 86.63 |
| MMLU (5-Shot) | 71.98 |
| TruthfulQA (0-shot) | 48.58 |
| Winogrande (5-shot) | 82.40 |
| GSM8k (5-shot) | 57.54 |
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Created
- Dec 18, 2023
- Updated
- Mar 7, 2024