Downloads · 30 days
15
4% of all-time downloads
yamatazen/HMS-Slerp-12B
HMS-Slerp-12B is a text generation model from yamatazen. Use it when you need the model to write or continue text. It is set up for transformers.
This is a ChatML model. Note: HMS stands for Himeyuri, Magnum and Shisa.
Downloads · 30 days
15
4% of all-time downloads
All-time downloads
359
Public
Parameters
12.2B
24.5 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README
This is a ChatML model.
Note: HMS stands for Himeyuri, Magnum and Shisa.
This is a merge of pre-trained language models created using mergekit.
This model was merged using the SLERP merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
base_model: yamatazen/Himeyuri-Magnum-12B
models:
- model: shisa-ai/shisa-v2-mistral-nemo-12b
merge_method: slerp
dtype: bfloat16
parameters:
normalize: true
t: [0.25, 0.3, 0.5, 0.3, 0.25]