Downloads · 30 days
9
12% of all-time downloads
Elfrino/XwinXtended_v1.0_20B
XwinXtended_v1.0_20B is a text generation model from Elfrino. Use it when you need the model to write or continue text. It is set up for transformers.
Just testing a frankenmerge of the first version of Xwin-LM-13B-V0.1....Comparing it's creativity to Xwin-LM-13B-V0.2
Downloads · 30 days
9
12% of all-time downloads
All-time downloads
75
Public
Parameters
20B
40 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors40 GB · 100%
From the Hugging Face model README
Just testing a frankenmerge of the first version of Xwin-LM-13B-V0.1....Comparing it's creativity to Xwin-LM-13B-V0.2
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Passthrough merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: Xwin-LM/Xwin-LM-13B-V0.1
layer_range: [0, 16]
- sources:
- model: Xwin-LM/Xwin-LM-13B-V0.1
layer_range: [8, 24]
- sources:
- model: Xwin-LM/Xwin-LM-13B-V0.1
layer_range: [17, 32]
- sources:
- model: Xwin-LM/Xwin-LM-13B-V0.1
layer_range: [25, 40]
merge_method: passthrough
dtype: bfloat16