Downloads · 30 days
10
3% of all-time downloads
LoneStriker/Mixtral-4x7B-DPO-RPChat-3.0bpw-h6-exl2-2
Mixtral-4x7B-DPO-RPChat-3.0bpw-h6-exl2-2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Mixtral-4x7B-DPO-RPChat is a model made primarely for RP (Roleplay), 2 RP model, 1 occult model and 1 DPO model for a MoE. Toppy was the base.
Downloads · 30 days
10
3% of all-time downloads
All-time downloads
346
Public
Repo size
9.3 GB
Likes
3
Public
Click a slice to open those files.
.safetensors9.3 GB · 100%
From the Hugging Face model README
Mixtral-4x7B-DPO-RPChat is a model made primarely for RP (Roleplay), 2 RP model, 1 occult model and 1 DPO model for a MoE. Toppy was the base.
The DPO was here to help get more human reply
This is my first try at doing this, so don't hesitate to give feedback!
WARNING: ALL THE "K" GGUF QUANT OF MIXTRAL MODELS SEEMS TO BE BROKEN, PREFER Q4_0, Q5_0 or Q8_0!
<!-- description start -->This repo contains fp16 files of Mixtral-4x7B-DPO-RPChat.
<!-- description end --> <!-- description start -->The list of model used and their activator/theme can be found here
<!-- description end --> <!-- prompt-template start -->Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
If you want to support me, you can here.