Downloads · 30 days
6
11% of all-time downloads
SensualNousInstructDARETIES-CATA-LimaRP-ZlossDT-SLERP-8x7B
Envoid/SensualNousInstructDARETIES-CATA-LimaRP-ZlossDT-SLERP-8x7B
SensualNousInstructDARETIES-CATA-LimaRP-ZlossDT-SLERP-8x7B is a text generation model from Envoid. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
56
Public
Parameters
46.7B
93.4 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- mixtral
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 17, 2024
- SHA
- f3f5f387
Try a prompt
Model card
From the Hugging Face model README
Caution:
This model may produce adult content.
This model first puts together:
Sao10K/Sensualize-Mixtral-bf16
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO
and
mistralai/Mixtral-8x7B-Instruct-v0.1
In a DARE TIES merge utilizing mistralai/Mixtral-8x7B-v0.1 as a base model.
The resulting model can now respond decently to both ChatML and Mixtral formatting. Unfortunately the warmer assistant personality of Nous Hermes is lost in the process. However much of Nous Hermes' excellent attention to detail and prose is carried forward when used for role play.
It was then merged together with
Envoid/CATA-LimaRP-Zloss-DT-TaskArithmetic-8x7B Utilizing the SLERP method.
Both merges were done using relatively normalized weights and densities without any gradients.
The end result is a fairly solid model for all of your SillyTavern needs, responding to either Mixtral Instruct or ChatML formatting.
Enjoy!
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- cc-by-nc-4.0
- Created
- Jan 16, 2024
- Updated
- Jan 17, 2024