Downloads · 30 days
9.2K
4% of all-time downloads
Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Slerp
Nous-Hermes-2-SUS-Chat-34B-Slerp is a text generation model from Weyaxi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Downloads · 30 days
9.2K
4% of all-time downloads
All-time downloads
212K
Public
Parameters
34.4B
68.8 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors68.8 GB · 100%
From the Hugging Face model README

This is the model for Nous-Hermes-2-SUS-Chat-34B-Slerp. I used mergekit to merge models.
You can use these prompt templates, but I recommend using ChatML.
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>
### Human: {user}
### Assistant: {asistant}
slices:
- sources:
- model: Nous-Hermes-2-Yi-34B
layer_range: [0, 60]
- model: SUS-Chat-34B
layer_range: [0, 60]
merge_method: slerp
base_model: Yi-34B
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
tokenizer_source: union
dtype: bfloat16
Quantizationed versions of this model is available thanks to TheBloke.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.06 |
| AI2 Reasoning Challenge (25-Shot) | 66.72 |
| HellaSwag (10-Shot) | 84.97 |
| MMLU (5-Shot) | 77.00 |
| TruthfulQA (0-shot) | 59.23 |
| Winogrande (5-shot) | 83.58 |
| GSM8k (5-shot) | 72.86 |