ZEUS-8B-V17-abliterated

ZEUS-8B-V17-abliterated

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the passthrough merge method.

Models Merged

The following models were included in the merge:

• T145/ZEUS-8B-V17
• Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2

Configuration

The following YAML configuration was used to produce this model:

slices:
  - sources:
    - model: T145/ZEUS-8B-V17
      layer_range: [0, 18]
  - sources:
    # Reasoning: The script used to abliterate V2 & V13 identified layer 19 as the target with the most refusal.
    # Substituting the whole layer with that from the uncensored model should effectively abliterate V17 and future similar merges.
    - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
      layer_range: [19, 19]
  - sources:
    - model: T145/ZEUS-8B-V17
      layer_range: [20, 32]
merge_method: passthrough
tokenizer_source: T145/ZEUS-8B-V17
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here! Summarized results can be found here!