Downloads · 30 days
9
11% of all-time downloads
Weyaxi/CarbonVillain-v4-Sakura-Solar-Slerp
CarbonVillain-v4-Sakura-Solar-Slerp is a text generation model from Weyaxi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is the model for CarbonVillain-v4-Sakura-Solar-Slerp. I used mergekit to merge models.
Downloads · 30 days
9
11% of all-time downloads
All-time downloads
82
Public
Parameters
10.7B
21.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors21.5 GB · 100%
From the Hugging Face model README
This is the model for CarbonVillain-v4-Sakura-Solar-Slerp. I used mergekit to merge models.
slices:
- sources:
- model: jeonsworld/CarbonVillain-en-10.7B-v4
layer_range: [0, 48]
- model: kyujinpy/Sakura-SOLAR-Instruct
layer_range: [0, 48]
merge_method: slerp
base_model: upstage/SOLAR-10.7B-Instruct-v1.0
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5 # fallback for rest of tensors
tokenizer_source: union
dtype: bfloat16