Downloads · 30 days
9
5% of all-time downloads
Kooten/Lelantos-Maid-DPO-7B-8bpw-exl2
Lelantos-Maid-DPO-7B-8bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.
Downloads · 30 days
9
5% of all-time downloads
All-time downloads
195
Public
Repo size
7.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors7.4 GB · 100%
From the Hugging Face model README
Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.
Exllama quant of SanjiWatsuki/Lelantos-Maid-DPO-7B
It is partly Noromaid so should be ChatML
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
Kooten on discord