MiquMaid-v2-2x70B-GGUF

MiquMaid v2 2x70B

Check out our blogpost about this model series Here! - Join our Discord server Here!

<center>[<a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B-GGUF">V2-70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B-DPO-GGUF">V2-70B-DPO</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B-GGUF">V2-2x70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B-DPO-GGUF">V2-2x70B-DPO</a>] </br> <div style="width: 100%;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/ro7nbLf4sfRFmFOWcQkUU.png" style="display: block; margin: auto;"> </div></center>

This model uses the Alpaca prompting format

Model trained for RP conversation on Miqu-70B with our magic sauce.

Then, we have done a MoE, made of MiquMaid-v2-70B and Miqu-70B base, making the model using the finetune AND the base model for each token, working together.

We have seen a significant improvement, so we decided to share that, even if the model is very big.

Credits:

• Undi
• IkariDev

Description

This repo contains GGUF files of MiquMaid-v2-2x70B.

Switch: FP16 - GGUF

Training data used:

• Aesir datasets
• NoRobots
• limarp
• toxic-dpo-v0.1-sharegpt
• ToxicQAFinal

Custom format:

### Instruction:
{system prompt}

### Input:
{input}

### Response:
{reply}

Others

Undi: If you want to support us, you can here.

IkariDev: Visit my retro/neocities style website please kek