Downloads · 30 days
23
1% of all-time downloads
ryzen88/Llama-3-70b-Arimas-story-RP-V1.5
Llama-3-70b-Arimas-story-RP-V1.5 is a text generation model from ryzen88. Use it when you need the model to write or continue text. It is set up for transformers.
Any feedback regarding the model its behaviour is very welcome. In V1 i experimented with a giraffe base but i noticed the giraffe version quickly lossed the long context ability.
Downloads · 30 days
23
1% of all-time downloads
All-time downloads
2K
Public
Parameters
70.6B
141 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors141 GB · 100%
From the Hugging Face model README
Any feedback regarding the model its behaviour is very welcome. In V1 i experimented with a giraffe base but i noticed the giraffe version quickly lossed the long context ability.
So in V1.5 i switched back to a gradient base.
This model was merged using the breadcrumbs_ties merge method using \Llama-3-70B-Instruct-Gradient-262k as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: \Llama-3-70B-Instruct-Gradient-262k
parameters:
weight: 0.40
density: 0.90
gamma: 0.01
- model: \Llama-3-70B-Instruct-abliterated-v3
parameters:
weight: 0.20
density: 0.90
gamma: 0.01
- model: \Smaug-Llama-3-70B-Instruct
parameters:
weight: 0.40
density: 0.90
gamma: 0.01
- model: \Llama-3-Lumimaid-70B-v0.1-OAS
parameters:
weight: 0.20
density: 0.90
gamma: 0.01
merge_method: breadcrumbs_ties
base_model: \Llama-3-70B-Instruct-Gradient-262k
dtype: bfloat16