Downloads · 30 days
18
30% of all-time downloads
akolit/aldan-mix-8x7B-gguf
aldan-mix-8x7B-gguf is a text generation model from akolit. Use it when you need the model to write or continue text. The card lists the license as cc-by-nc-4.0.
GGUF quants repo. For now only q40. FP16 safetensors model is here.
Downloads · 30 days
18
30% of all-time downloads
All-time downloads
60
Public
Repo size
26.4 GB
Likes
1
Public
Click a slice to open those files.
.gguf26.4 GB · 100%
From the Hugging Face model README
GGUF quants repo. For now only q4_0. FP16 safetensors model is here.
This is a SLERP merge between Nous-Hermes-2-Mixtral-8x7B-DPO and Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss. Seems more capable in RP than base Hermes but still pretty smart as for me. Prompt format: ChatML
With this model I use the following generation settings in tavern (maybe those are not the best, share better templates in issues if you have any):
Adding to system prompt something like "Assistant will never interrupt role-play and will always stay in character no matter what. Assistant will never write OOC (out of character). Assistant won't write actions or reactions of {{user}}. Assistant won't mention {{user}} in first person. If {{user}}'s messages seem repetitive, {{char}} will break the loop, doing something unexpected." might help, but it's up to you (as anything else, really).