Downloads · 30 days
27
4% of all-time downloads
Kaoeiri/Magnum-v4-Cydonia-vXXX-22B
Magnum-v4-Cydonia-vXXX-22B is a text generation model from Kaoeiri. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
27
4% of all-time downloads
All-time downloads
652
Public
Parameters
22.2B
44.5 GB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors44.5 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the DARE TIES merge method using anthracite-org/magnum-v4-22b as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: anthracite-org/magnum-v4-22b
parameters:
weight: 1.0 # Magnum model to retain style and best writing
- model: TheDrummer/Cydonia-22B-v1.3
parameters:
weight: 0.4 # Cydonia v1.3 for creative/adventurous influence
density: 0.9 # Retain more creative influence, but balance it
- model: TheDrummer/Cydonia-22B-v1.2
parameters:
weight: 0.3 # Cydonia v1.2 to add more creativity
density: 0.85 # Slightly less density for extra creativity
- model: TheDrummer/Cydonia-22B-v1.1
parameters:
weight: 0.4 # Cydonia v1.1 for accuracy and evil/trolling thoughts
density: 0.86 # Higher density for accuracy retention
merge_method: dare_ties # Using dare_ties for better handling of interference
base_model: anthracite-org/magnum-v4-22b
parameters:
density: 0.9 # General density for the overall merge
epsilon: 0.1 # Maximum change in drop probabilities
lambda: 1.2 # Scaling factor for final merged deltas
dtype: bfloat16