Downloads · 30 days
3
1% of all-time downloads
LoneStriker/Nous-Hermes-2-SUS-Chat-34B-Slerp-3.0bpw-h6-exl2
Nous-Hermes-2-SUS-Chat-34B-Slerp-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Downloads · 30 days
3
1% of all-time downloads
All-time downloads
203
Public
Repo size
13.9 GB
Likes
1
Public
Click a slice to open those files.
.safetensors13.9 GB · 100%
From the Hugging Face model README

This is the model for Nous-Hermes-2-SUS-Chat-34B-Slerp. I used mergekit to merge models.
slices:
- sources:
- model: Nous-Hermes-2-Yi-34B
layer_range: [0, 60]
- model: SUS-Chat-34B
layer_range: [0, 60]
merge_method: slerp
base_model: Yi-34B
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
tokenizer_source: union
dtype: bfloat16