Downloads · 30 days
53
66% of all-time downloads
TareksTesting/Legion-V1-LLaMa-70B
Legion-V1-LLaMa-70B is a text generation model from TareksTesting. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.3.
Downloads · 30 days
53
66% of all-time downloads
All-time downloads
80
Public
Parameters
70.6B
141 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors141 GB · 100%
From the Hugging Face model README
~ We are Legion...
My biggest merge yet, consisting of a total of 15 specially curated models. My methodology in approaching this was to create 5 highly specialized models:
These five models went through a series of iterations until I got something I thought worked well and then combined them to make LEGION.
The full list of models used in this merge is below:
This is a merge of pre-trained language models created using mergekit.
This model was merged using the DARE TIES merge method using TareksLab/M-BASE-SCE as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: TareksLab/M-MERGE4
parameters:
weight: 0.20
density: 0.5
- model: TareksLab/M-MERGE3
parameters:
weight: 0.20
density: 0.5
- model: TareksLab/M-MERGE2
parameters:
weight: 0.20
density: 0.5
- model: TareksLab/M-MERGE1
parameters:
weight: 0.20
density: 0.5
- model: TareksLab/M-BASE-SCE
parameters:
weight: 0.20
density: 0.5
merge_method: dare_ties
base_model: TareksLab/M-BASE-SCE
parameters:
normalize: false
out_dtype: bfloat16
tokenizer:
source: TareksLab/M-TOKENIZER-SCE