Downloads · 30 days
54
0% of all-time downloads
Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Linear
Nous-Hermes-2-SUS-Chat-34B-Linear is a text generation model from Weyaxi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Downloads · 30 days
54
0% of all-time downloads
All-time downloads
39.1K
Public
Parameters
34.4B
68.8 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors68.8 GB · 100%
From the Hugging Face model README

This is the model for Nous-Hermes-2-SUS-Chat-34B-Linear. I used mergekit to merge models.
models:
- model: Nous-Hermes-2-Yi-34B
parameters:
weight: 0.5
- model: SUS-Chat-34B
parameters:
weight: 0.3
merge_method: linear
dtype: bfloat16
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 73.69 |
| AI2 Reasoning Challenge (25-Shot) | 66.38 |
| HellaSwag (10-Shot) | 84.94 |
| MMLU (5-Shot) | 76.82 |
| TruthfulQA (0-shot) | 59.19 |
| Winogrande (5-shot) | 82.79 |
| GSM8k (5-shot) | 72.02 |