MiquMaid-v2-70B-DPO

MiquMaid v2 DPO

Check out our blogpost about this model series Here! - Join our Discord server Here!

<center>[<a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B">V2-70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B-DPO">V2-70B-DPO</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B">V2-2x70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B-DPO">V2-2x70B-DPO</a>] </br> <div style="width: 100%;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/tPFdudSae6SCDNvhe1lC9.png" style="display: block; margin: auto;"> </div></center>

This model uses the Alpaca prompting format

Model trained for RP conversation on Miqu-70B with our magic sauce, then trained on DPO for uncensoring.

Credits:

• Undi
• IkariDev

Description

This repo contains FP16 files of MiquMaid-v2-70B-DPO.

Switch: FP16 - GGUF

Training data used:

• Aesir datasets
• NoRobots
• limarp
• toxic-dpo-v0.1-sharegpt
• ToxicQAFinal

DPO training data used:

• ToxicDPOqa
• toxic-dpo-v0.1-NoWarning

Custom format:

### Instruction:
{system prompt}

### Input:
{input}

### Response:
{reply}

Others

Undi: If you want to support us, you can here.

IkariDev: Visit my retro/neocities style website please kek