Brimful-290B-merged-replete

Solshine/Brimful-290B-merged-replete
Brimful-290B-merged-replete is a text generation model from Solshine. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
14% of all-time downloads
All-time downloads
Public
Parameters
290B
580 GB on disk
Likes
Public
Hugging Face
Repo makeup

Click a slice to open those files.
.safetensors580 GB · 100%
At a glance

Task: Text Generation
Library: transformers
Model type: qwen2
Access: Public
Created: Oct 1, 2024
Updated: Oct 17, 2024
SHA: 51e51830
Try a prompt

Base models

Model card

From the Hugging Face model README
merge

This is a merge of pre-trained language models created using mergekit.
Merge Details

Merge Method

This model was merged using the passthrough merge method.
This model recieved no post merge retraining (yet) and minimal testing. Please contribute any feedback or evaluations of any kind via the community tab.
Models Merged

The following models were included in the merge:
Configuration

The following YAML configuration was used to produce this model:
slices:
  # Replete-AI Layer 0, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [0, 1]

  # Qwen 72B Layer 0, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [0, 1]

  # Replete-AI Layer 1, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [1, 2]

  # Qwen 72B Layer 1, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [1, 2]

  # Replete-AI Layer 2, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [2, 3]

  # Qwen 72B Layer 2, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [2, 3]

  # Replete-AI Layer 3, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [3, 4]

  # Qwen 72B Layer 3, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [3, 4]

  # Replete-AI Layer 4, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [4, 5]

  # Qwen 72B Layer 4, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [4, 5]

  # Replete-AI Layer 5, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [5, 6]

  # Qwen 72B Layer 5, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [5, 6]

  # Replete-AI Layer 6, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [6, 7]

  # Qwen 72B Layer 6, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [6, 7]

  # Replete-AI Layer 7, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [7, 8]

  # Qwen 72B Layer 7, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [7, 8]

  # Replete-AI Layer 8, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [8, 9]

  # Qwen 72B Layer 8, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [8, 9]

  # Replete-AI Layer 9, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [9, 10]

  # Qwen 72B Layer 9, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [9, 10]

  # Replete-AI Layer 10, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [10, 11]

  # Qwen 72B Layer 10, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [10, 11]

  # Replete-AI Layer 11, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [11, 12]

  # Qwen 72B Layer 11, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [11, 12]

  # Replete-AI Layer 12, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [12, 13]

  # Qwen 72B Layer 12, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [12, 13]

  # Replete-AI Layer 13, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [13, 14]

  # Qwen 72B Layer 13, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [13, 14]

  # Replete-AI Layer 14, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [14, 15]

  # Qwen 72B Layer 14, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [14, 15]

  # Replete-AI Layer 15, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [15, 16]

  # Qwen 72B Layer 15, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [15, 16]

  # Replete-AI Layer 16, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [16, 17]

  # Qwen 72B Layer 16, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [16, 17]

  # Replete-AI Layer 17, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [17, 18]

  # Qwen 72B Layer 17, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [17, 18]

  # Replete-AI Layer 18, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [18, 19]

  # Qwen 72B Layer 18, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [18, 19]

  # Replete-AI Layer 19, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [19, 20]

  # Qwen 72B Layer 19, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [19, 20]

  # Replete-AI Layer 20, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [20, 21]

  # Qwen 72B Layer 20, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [20, 21]

  # Replete-AI Layer 21, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [21, 22]

  # Qwen 72B Layer 21, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [21, 22]

  # Replete-AI Layer 22, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [22, 23]

  # Qwen 72B Layer 22, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [22, 23]

  # Replete-AI Layer 23, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [23, 24]

  # Qwen 72B Layer 23, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [23, 24]

  # Replete-AI Layer 24, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [24, 25]

  # Qwen 72B Layer 24, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [24, 25]

  # Replete-AI Layer 25, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [25, 26]

  # Qwen 72B Layer 25, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [25, 26]

  # Replete-AI Layer 26, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [26, 27]

  # Qwen 72B Layer 26, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [26, 27]

  # Replete-AI Layer 27, repeated 8 times
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]
  - sources:
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-7b
        layer_range: [27, 28]

  # Qwen 72B Layer 27, repeated 8 times
  - sources:
      - model: Qwen/Qwen2.5-72B-Instruct
        layer_range: [27, 80]

merge_method: passthrough
dtype: float16
Task: Text Generation
Library: transformers
Type: qwen2
Created: Oct 1, 2024
Updated: Oct 17, 2024