Downloads · 30 days
12
4% of all-time downloads
ayousanz/ca-youri-7B-merge-slerp
ca-youri-7B-merge-slerp is a text generation model from ayousanz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
ca-youri-7B-merge-slerp is a merge of the following models using mergekit: cyberagent/calm2-7b-chat rinna/youri-7b-instruction
Downloads · 30 days
12
4% of all-time downloads
All-time downloads
294
Public
Parameters
6.7B
13.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors13.5 GB · 100%
From the Hugging Face model README
ca-youri-7B-merge-slerp is a merge of the following models using mergekit:
slices:
- sources:
- model: cyberagent/calm2-7b-chat
layer_range: [0, 32]
- model: rinna/youri-7b-instruction
layer_range: [0, 32]
merge_method: slerp
base_model: cyberagent/calm2-7b-chat
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16