Downloads · 30 days
7
4% of all-time downloads
kim512/Llama-3-70b-Arimas-story-RP-V1-4.0bpw-exl2
Llama-3-70b-Arimas-story-RP-V1-4.0bpw-exl2 is a text generation model from kim512. Use it when you need the model to write or continue text. It is set up for transformers.
3.00 bits per weight 3.50 bits per weight 4.00 bits per weight 4.50 bits per weight
Downloads · 30 days
7
4% of all-time downloads
All-time downloads
183
Public
Repo size
37.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors37.2 GB · 100%
From the Hugging Face model README
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
This is really a followup and improvement off my original Lumi-Tess model.
A large context uncencored Llama 3 instruct model focussed on story & RP. I found the Smaug version of lama very impressive, exept for a couple of quirks and the default context window. This merge is with the Giraffe instruct for long context window, and basically a smaug - lumi tess merger. I am planning to do the same with a gradient model and compaire it to this giraffe version. Breadcrumbs_ties really is awesome.
This is a merge of pre-trained language models created using mergekit. A big thanks to the creators of the models used in this merge
This model was merged using the breadcrumbs_ties merge method using Z:\Llama-3-Giraffe-70B-Instruct as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: \Llama-3-Giraffe-70B-Instruct
parameters:
weight: 0.25
density: 0.90
gamma: 0.01
- model: \Smaug-Llama-3-70B-Instruct
parameters:
weight: 0.30
density: 0.90
gamma: 0.01
- model: \Tess-2.0-Llama-3-70B-v0.2
parameters:
weight: 0.15
density: 0.90
gamma: 0.01
- model: \Llama-3-Lumimaid-70B-v0.1-alt
parameters:
weight: 0.30
density: 0.90
gamma: 0.01
merge_method: breadcrumbs_ties
base_model: \Llama-3-Giraffe-70B-Instruct
dtype: bfloat16