Downloads · 30 days
7
4% of all-time downloads
LoneStriker/Crunchy-onion-3.0bpw-h6-exl2
Crunchy-onion-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as agpl-3.0.
This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).
Downloads · 30 days
7
4% of all-time downloads
All-time downloads
185
Public
Repo size
17.8 GB
Likes
0
Public
Click a slice to open those files.
.safetensors17.8 GB · 100%
From the Hugging Face model README
This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).
The 4-bit qlora was then merged into Mixtral Instruct resulting in what you see here.
Works best with ChatML Instruct