Downloads · 30 days
6
4% of all-time downloads
Aleteian/Legend-of-the-Four-Winds-2-MN-12B
Legend-of-the-Four-Winds-2-MN-12B is a text generation model from Aleteian. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
6
4% of all-time downloads
All-time downloads
153
Public
Parameters
12.2B
24.5 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Breadcrumbs with TIES merge method using Aleteian/Saiga-Unleashed as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: Aleteian/Saiga-Unleashed
parameters:
weight: 0.4
- model: Aleteian/NeverendingStory
parameters:
density: 0.95
weight: 0.4
gamma: 0.01
- model: LatitudeGames/Wayfarer-12B
parameters:
density: 0.9
weight: 0.1
gamma: 0.01
- model: nbeerbower/Lyra4-Gutenberg2-12B
parameters:
density: 0.9
weight: 0.1
gamma: 0.01
merge_method: breadcrumbs_ties
base_model: Aleteian/Saiga-Unleashed
dtype: bfloat16
tokenizer_source: "union"
chat_template: "auto"