Violet-Eclipse-12B

merged

This is a merge of pre-trained language models created using mergekit.

Data

i didn't add any new data so nothing, I just merged the models

🧪 Intended Use

This model is designed mainly for:

• Roleplay and creative writing

😷 Ethical Containment

This model can:

• ⚠️ Generating unfiltered creative content
• ⚠️ Producing potentially disturbing narratives
• ⚠️ Creating NSFW content

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Retreatcost/KansenSakura-Erosion-RP-12b as a base.

Models Merged

The following models were included in the merge:

• SicariusSicariiStuff/Impish_Nemo_12B
• inflatebot/guns-and-roses-r1
• Retreatcost/Forgotten-directive-Neon-stock
• FallenMerick/MN-Violet-Lotus-12B

⚖️ License

Follow the licensing terms of each merged model:

Each source model’s license applies

Configuration

The following YAML configuration was used to produce this model:

base_model: Retreatcost_KansenSakura-Erosion-RP-12b
dtype: bfloat16
merge_method: model_stock
modules:
  default:
    slices:
    - sources:
      - layer_range: [0, 40]
        model: Retreatcost/Forgotten-directive-Neon-stock
        parameters:
          weight: 0.2
      - layer_range: [0, 40]
        model: Retreatcost/KansenSakura-Erosion-RP-12b
        parameters:
          weight: 0.3
      - layer_range: [0, 40]
        model: SicariusSicariiStuff/Impish_Nemo_12B
        parameters:
          weight: 0.3
      - layer_range: [0, 40]
        model: inflatebot/guns-and-roses-r1
        parameters:
          weight: 0.15
      - layer_range: [0, 40]
        model: FallenMerick/MN-Violet-Lotus-12B
        parameters:
          weight: 0.15
parameters:
  normalize: 1.0
tokenizer:
  source: base

✨ Acknowledgements

Thanks to the authors of the original models for their incredible work:

• SicariusSicariiStuff for Impish Nemo 12B

• Retreatcost for KansenSakura-Erosion-RP-12b and Forgotten-directive-Neon-stock

• inflatebot for guns-and-roses-r1

• FallenMerick for MN-Violet-Lotus-12B