Downloads · 30 days
3
6% of all-time downloads
LoneStriker/Nous-Hermes-2-SUS-Chat-34B-Slerp-5.0bpw-h6-exl2
Nous-Hermes-2-SUS-Chat-34B-Slerp-5.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Downloads · 30 days
3
6% of all-time downloads
All-time downloads
48
Public
Repo size
22.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors22.2 GB · 100%
From the Hugging Face model README

This is the model for Nous-Hermes-2-SUS-Chat-34B-Slerp. I used mergekit to merge models.
slices:
- sources:
- model: Nous-Hermes-2-Yi-34B
layer_range: [0, 60]
- model: SUS-Chat-34B
layer_range: [0, 60]
merge_method: slerp
base_model: Yi-34B
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
tokenizer_source: union
dtype: bfloat16