Downloads · 30 days
19
9% of all-time downloads
yamatazen/DellaMix-12B
DellaMix-12B is a text generation model from yamatazen. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
19
9% of all-time downloads
All-time downloads
216
Public
Parameters
12.2B
24.5 GB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README

This is a merge of pre-trained language models created using mergekit.
This model was merged using the DELLA merge method using yamatazen/EtherealAurora-12B-Lorablated as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
merge_method: della
dtype: bfloat16
out_dtype: bfloat16
base_model: yamatazen/EtherealAurora-12B-Lorablated
models:
- model: yamatazen/Shisa-v2-Mistral-Nemo-12B-Abliterated
parameters:
density: 0.6
weight: 0.7
- model: yamatazen/ForgottenMaid-12B
parameters:
density: 0.6
weight: 0.5
- model: yamatazen/FusionEngine-12B
parameters:
density: 0.5
weight: 0.3
parameters:
epsilon: 0.1
lambda: 1.0