Downloads · 30 days
27
1% of all-time downloads
Weyaxi/Einstein-v6.1-LLama3-8B-Instruct-Ties
Einstein-v6.1-LLama3-8B-Instruct-Ties is a text generation model from Weyaxi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
27
1% of all-time downloads
All-time downloads
2.9K
Public
Parameters
8B
16.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the TIES merge method using meta-llama/Meta-Llama-3-8B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: meta-llama/Meta-Llama-3-8B
#no parameters necessary for base model
- model: Weyaxi/Einstein-v6.1-Llama3-8B
parameters:
density: 0.5
weight: 0.5
- model: meta-llama/Meta-Llama-3-8B-Instruct
parameters:
density: 0.5
weight: 0.5
merge_method: ties
base_model: meta-llama/Meta-Llama-3-8B
parameters:
normalize: false
int8_mask: true
dtype: bfloat16