Downloads · 30 days
7
3% of all-time downloads
LoneStriker/Crunchy-onion-3.75bpw-h6-exl2
Crunchy-onion-3.75bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as agpl-3.0.
This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).
Downloads · 30 days
7
3% of all-time downloads
All-time downloads
249
Public
Repo size
22.2 GB
Likes
1
Public
Click a slice to open those files.
.safetensors22.2 GB · 100%
From the Hugging Face model README
This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).
The 4-bit qlora was then merged into Mixtral Instruct resulting in what you see here.
Works best with ChatML Instruct