Downloads · 30 days
71
41% of all-time downloads
kaitchup/Maixtchup-4x7b
Maixtchup-4x7b is a text generation model from kaitchup. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a mixture of experts created with mergekit and based on mistralai/Mistral-7B-v0.1.
Downloads · 30 days
71
41% of all-time downloads
All-time downloads
174
Public
Parameters
24.2B
48.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors48.3 GB · 100%
From the Hugging Face model README
This is a mixture of experts created with mergekit and based on mistralai/Mistral-7B-v0.1.
The method and code used to quantize the model is explained here: Maixtchup: Make Your Own Mixture of Experts with Mergekit
This model is pre-trained and not fine-tuned. You may fine-tune it with PEFT using adapters.