Downloads · 30 days
165
5% of all-time downloads
RichardErkhov/Weyaxi_-_Nous-Hermes-2-SUS-Chat-34B-Slerp-gguf
Weyaxi_-_Nous-Hermes-2-SUS-Chat-34B-Slerp-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
165
5% of all-time downloads
All-time downloads
3.3K
Public
Repo size
389 GB
Likes
0
Public
Click a slice to open those files.
.gguf451 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Nous-Hermes-2-SUS-Chat-34B-Slerp - GGUF
license: other tags:

This is the model for Nous-Hermes-2-SUS-Chat-34B-Slerp. I used mergekit to merge models.
You can use these prompt templates, but I recommend using ChatML.
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>
### Human: {user}
### Assistant: {asistant}
slices:
- sources:
- model: Nous-Hermes-2-Yi-34B
layer_range: [0, 60]
- model: SUS-Chat-34B
layer_range: [0, 60]
merge_method: slerp
base_model: Yi-34B
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
tokenizer_source: union
dtype: bfloat16
Quantizationed versions of this model is available thanks to TheBloke.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.06 |
| AI2 Reasoning Challenge (25-Shot) | 66.72 |
| HellaSwag (10-Shot) | 84.97 |
| MMLU (5-Shot) | 77.00 |
| TruthfulQA (0-shot) | 59.23 |
| Winogrande (5-shot) | 83.58 |
| GSM8k (5-shot) | 72.86 |