Downloads · 30 days
24
40% of all-time downloads
VoidStare/Progenitor-V1.1-LLaMa-70B-EXL2-6.5bpw-h8
Progenitor-V1.1-LLaMa-70B-EXL2-6.5bpw-h8 is a text generation model from VoidStare. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.3.
This model is part of a series of experiments in merging some of my favorite Llama models, an idea which was based on the excellent Steelskull/L3.3-MS-Nevoria-70b merge, just with a couple of extra ingredients and dif…
Downloads · 30 days
24
40% of all-time downloads
All-time downloads
60
Public
Repo size
58.7 GB
Likes
0
Public
Click a slice to open those files.
.safetensors58.7 GB · 100%
From the Hugging Face model README
This model is part of a series of experiments in merging some of my favorite Llama models, an idea which was based on the excellent Steelskull/L3.3-MS-Nevoria-70b merge, just with a couple of extra ingredients and different merge methods. Here I tried a Della Linear merge with aggressive parameters. The results came out really nice, I really enjoy this model.
This is a merge of pre-trained language models created using mergekit.
This model was merged using the della_linear merge method using nbeerbower/Llama-3.1-Nemotron-lorablated-70B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: Sao10K/L3.1-70B-Hanami-x1
parameters:
weight: 0.20
density: 0.7
- model: Sao10K/70B-L3.3-Cirrus-x1
parameters:
weight: 0.20
density: 0.7
- model: SicariusSicariiStuff/Negative_LLAMA_70B
parameters:
weight: 0.20
density: 0.7
- model: TheDrummer/Anubis-70B-v1
parameters:
weight: 0.20
density: 0.7
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
parameters:
weight: 0.20
density: 0.7
merge_method: della_linear
base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
parameters:
epsilon: 0.2
lambda: 1.1
dtype: bfloat16
tokenizer_source: base