Downloads · 30 days
1
100% of all-time downloads
OpenDolphinMaid-4x7b-exl2
IHaBiS/OpenDolphinMaid-4x7b-exl2
OpenDolphinMaid-4x7b-exl2 is a machine learning model from IHaBiS. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
All-time downloads
1
Public
Repo size
21.3 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
Other1.5 KB · 53%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 17, 2024
- SHA
- c037ed51
Model card
From the Hugging Face model README
Exl2 version of Undi95/OpenDolphinMaid-4x7b
branch
7bh8 : 7bpw h8
Using ThePile 0007.parquet as dataset
Quantization settings : python convert.py -i models/Undi95_OpenDolphinMaid-4x7b -o OpenDolphinMaid-4x7b-temp -cf OpenDolphinMaid-4x7b-7bpw-h8-exl2 -c 0007.parquet -l 8192 -b 7 -hb 8 -ml 8192
below this line is original readme
Merge of OpenHermes and Dolphin with 2x Noromaid DPO, trying to add a little more brain in the model, while being smaller than a 8x7b.
It seems to work well.
<!-- description start -->Description
This repo contains fp16 files of OpenDolphinMaid-4x7b.
<!-- description end --> <!-- description start -->Models and LoRA used
- NeverSleep/Noromaid-7B-0.4-DPO x 2
- teknium/OpenHermes-2.5-Mistral-7B
- cognitivecomputations/dolphin-2.6-mistral-7b-dpo
Prompt template: Chatml
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
If you want to support me, you can here.
- License
- cc-by-nc-4.0
- Created
- Jan 16, 2024
- Updated
- Jan 17, 2024