Downloads · 30 days
7
9% of all-time downloads
Natkituwu/Erosumika-7B-v3-4.0bpw-exl2
Erosumika-7B-v3-4.0bpw-exl2 is a text generation model from Natkituwu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
<h1 style="text-align: center"Erosumika-7B-v3</h1
Downloads · 30 days
7
9% of all-time downloads
All-time downloads
75
Public
Repo size
3.9 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3.9 GB · 100%
From the Hugging Face model README
4.0bpw exl2 quant. great for 16k+ context on 6GB GPUS!
Original Model : (https://huggingface.co/localfultonextractor/Erosumika-7B-v3)
A DARE TIES merge between Nitral's Kunocchini-7b, Endevor's InfinityRP-v1-7B and my FlatErosAlpha, a flattened(in order to keep the vocab size 32000) version of tavtav's eros-7B-ALPHA. Alpaca and ChatML work best.
The intended use-case for this model is fictional writing for entertainment purposes. Any other sort of usage is out of scope. It may produce socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive. Outputs might often be factually wrong or misleading.
base_model: localfultonextractor/FlatErosAlpha
models:
- model: localfultonextractor/FlatErosAlpha
- model: Epiculous/InfinityRP-v1-7B
parameters:
density: 0.4
weight: 0.25
- model: Nitral-AI/Kunocchini-7b
parameters:
density: 0.3
weight: 0.35
merge_method: dare_ties
dtype: bfloat16
Note: Copied the tokenizer from InfinityRP-v1-7B.