Downloads · 30 days
7
1% of all-time downloads
Kooten/LemonadeRP-4.5.3-4bpw-exl2
LemonadeRP-4.5.3-4bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
Exllama quant of KatyTheCutie/LemonadeRP-4.5.3 7B roleplay focused model, creativity and less cliché is the focus of this merge.
Downloads · 30 days
7
1% of all-time downloads
All-time downloads
507
Public
Repo size
3.9 GB
Likes
2
Public
Click a slice to open those files.
.safetensors3.9 GB · 100%
From the Hugging Face model README
Exllama quant of KatyTheCutie/LemonadeRP-4.5.3
7B roleplay focused model, creativity and less cliché is the focus of this merge.
Based on the models going in to this I would assume Chatml is the appropriate format.
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
Kooten on discord
ko-fi.com/kooten if you would like to support me