Downloads · 30 days
7
3% of all-time downloads
Kooten/Lelantos-Maid-DPO-7B-4bpw-exl2
Lelantos-Maid-DPO-7B-4bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.
Downloads · 30 days
7
3% of all-time downloads
All-time downloads
244
Public
Repo size
3.9 GB
Likes
1
Public
Click a slice to open those files.
.safetensors3.9 GB · 100%
From the Hugging Face model README
Note: There have been issues with never ending generations for the exl quant of this model, i have not been able to figure out why, though it works for some.
Exllama quant of SanjiWatsuki/Lelantos-Maid-DPO-7B
It is partly Noromaid so should be ChatML
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
Kooten on discord