Downloads · 30 days
18
32% of all-time downloads
fradinho/world-llama2
world-llama2 is a text generation model from fradinho. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
18
32% of all-time downloads
All-time downloads
57
Public
Parameters
6.7B
13.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors13.5 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the task arithmetic merge method using LargeWorldModel/LWM-Text-Chat-1M as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: LargeWorldModel/LWM-Text-Chat-1M
parameters:
weight: 0.5
- model: NousResearch/Llama-2-7b-chat-hf
parameters:
weight: 0.5
merge_method: task_arithmetic
base_model: LargeWorldModel/LWM-Text-Chat-1M
parameters:
normalize: true
int8_mask: true
dtype: bfloat16