Downloads · 30 days
5
10% of all-time downloads
LoneStriker/MiquMaid-v2-2x70B-DPO-3.0bpw-h6-exl2
MiquMaid-v2-2x70B-DPO-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Check out our blogpost about this model series Here! - Join our Discord server Here!
Downloads · 30 days
5
10% of all-time downloads
All-time downloads
48
Public
Repo size
47.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors47.5 GB · 100%
From the Hugging Face model README
Check out our blogpost about this model series Here! - Join our Discord server Here!
<center>[<a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B">V2-70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B-DPO">V2-70B-DPO</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B">V2-2x70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B-DPO">V2-2x70B-DPO</a>] </br> <div style="width: 100%;"> <img src="https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/Wbzwoko-IZbOJfvPaImre.png" style="display: block; margin: auto;"> </div></center>This model uses the Alpaca prompting format
Then, we have done a MoE, made of MiquMaid-v2-70B-DPO and Miqu-70B-DPO base, making the model using the finetune AND the base model for each token, working together.
The two model have been trained on DPO for uncensoring, more info on Miqu-70B-DPO here
We have seen a significant improvement, so we decided to share that, even if the model is very big.
This repo contains FP16 files of MiquMaid-v2-2x70B-DPO.
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Undi: If you want to support us, you can here.
IkariDev: Visit my retro/neocities style website please kek