Downloads · 30 days
135
25% of all-time downloads
noguchis/vicuna-13b-v1.5-16k_ELYZA-japanese-Llama-2-13b-instruct
vicuna-13b-v1.5-16k_ELYZA-japanese-Llama-2-13b-instruct is a text generation model from noguchis. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
basemodel: - elyza/ELYZA-japanese-Llama-2-13b-instruct - lmsys/vicuna-13b-v1.5-16k tags: - mergekit - merge
Downloads · 30 days
135
25% of all-time downloads
All-time downloads
548
Public
Parameters
13B
26 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors26 GB · 100%
From the Hugging Face model README
base_model:
This is a merge of pre-trained language models created using mergekit.
This model was merged using the SLERP merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: elyza/ELYZA-japanese-Llama-2-13b-instruct
layer_range: [0, 40]
- model: lmsys/vicuna-13b-v1.5-16k
layer_range: [0, 40]
merge_method: slerp
base_model: lmsys/vicuna-13b-v1.5-16k
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5 # fallback for rest of tensors
dtype: float16