Downloads · 30 days
78
0% of all-time downloads
Nous-Hermes-2-SUS-Chat-2x34B
Weyaxi/Nous-Hermes-2-SUS-Chat-2x34B
Nous-Hermes-2-SUS-Chat-2x34B is a text generation model from Weyaxi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is the model for Nous-Hermes-2-SUS-Chat-2x34B. I used mergekit to merge models.
All-time downloads
39.1K
Public
Parameters
60.8B
122 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors122 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- mixtral
- Access
- Public
- Created
- Jan 3, 2024
- Updated
- Jan 21, 2024
- SHA
- a2fb649d
Try a prompt
Model card
From the Hugging Face model README
Nous-Hermes-2-SUS-Chat-2x34B
This is the model for Nous-Hermes-2-SUS-Chat-2x34B. I used mergekit to merge models.
Yaml Config
base_model: Yi-34B
gate_mode: hidden
dtype: bfloat16
experts:
- source_model: Nous-Hermes-2-Yi-34B
positive_prompts: [""]
- source_model: SUS-Chat-34B
positive_prompts: [""]
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 73.82 |
| AI2 Reasoning Challenge (25-Shot) | 66.81 |
| HellaSwag (10-Shot) | 85.22 |
| MMLU (5-Shot) | 76.65 |
| TruthfulQA (0-shot) | 57.42 |
| Winogrande (5-shot) | 83.74 |
| GSM8k (5-shot) | 73.09 |
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- other
- Created
- Jan 3, 2024
- Updated
- Jan 21, 2024