MiquMaid-v3-70B-bpw2.5

MiquMaid v3

Check out our blogpost about this model series Here! - Join our Discord server Here!

<center><div style="width: 100%;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/4smLWpA55KgIbj4kH1zyF.png" style="display: block; margin: auto;"> </div></center>

This model uses the Alpaca prompting format

Model trained for RP conversation on Miqu-70B with our magic sauce. Then we made an enormous merge containing all out old iteration of Miqumaid, and some other RP Miqu based model, with the new Model Stock merging method.

Credits:

• Undi
• IkariDev

Description

This repo contains FP16 files of MiquMaid-v3-70B.

Switch: FP16 - GGUF

Training data used:

• Aesir datasets
• NoRobots
• limarp - 8k ctx
• toxic-dpo-v0.1-sharegpt
• ToxicQAFinal
• Luminae-i1 - Ikari's Dataset
• Squish42/bluemoon-fandom-1-1-rp-cleaned - 50% (randomly)
• NobodyExistsOnTheInternet/PIPPAsharegptv2test - 5% (randomly)
• cgato/SlimOrcaDedupCleaned - 5% (randomly)

Models used

• NeverSleep/MiquMaid-70B-v3-Base [Private finetune]
• NeverSleep/MiquMaid-v2-70B
• NeverSleep/MiquMaid-v1-70B
• migtissera/Tess-70B-v1.6
• crestf411/daybreak-miqu-1-70b-v1.0-hf
• sophosympatheia/Midnight-Miqu-70B-v1.0

Custom format:

### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}

Mistral [INST][/INST] prompt format should work too.

Others

Undi: If you want to support us, you can here.

IkariDev: Visit my retro/neocities style website please kek