Downloads · 30 days
5
13% of all-time downloads
bluuwhale/Fish-8x7B-3.7bpw-h6-exl2-rpcal
Fish-8x7B-3.7bpw-h6-exl2-rpcal is a text generation model from bluuwhale. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Downloads · 30 days
5
13% of all-time downloads
All-time downloads
40
Public
Repo size
21.8 GB
Likes
0
Public
Click a slice to open those files.
.safetensors21.8 GB · 100%
From the Hugging Face model README

For this model I took the following LoRAs
SeanWu25/Mixtral_8x7b_Medicine
and
And merged them onto their base model.
I then did a simple linear merge between them, an experimental unreleased 8x7B model, and an unreleased model that was a intermediate step in creating Envoid/BondBurger-8x7B
The end results are a surprisingly good model for role palying style entertainment.
At first I was disappointed with the results but ended up settling on the following sampler parameters which really bring it to life.

It responds well to [INST] do a thing [/INST] instruct style formatting (although uses the ChatML special tokens)