Downloads · 30 days
12
24% of all-time downloads
Mixtral-8x7B-Instruct-v0.1-3bit-exl2
n810x/Mixtral-8x7B-Instruct-v0.1-3bit-exl2
Mixtral-8x7B-Instruct-v0.1-3bit-exl2 is a text generation model from n810x. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 3-bit exl2 (Exllamav2) conversion of MistralAI's Mixtral-8x7B-Instruct-v0.1
All-time downloads
49
Public
Repo size
17.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Mar 13, 2024
- Updated
- Mar 14, 2024
- SHA
- 62d2310e
Try a prompt
Model card
From the Hugging Face model README
This is a 3-bit exl2 (Exllamav2) conversion of MistralAI's Mixtral-8x7B-Instruct-v0.1
It takes about 17GB on disk, so it should load on consumer cards with 24GB of VRAM.
- More on ExLlamav2 -> https://github.com/turboderp/exllamav2 ( works with Oobabooga's textgen web ui )
- Original Model -> https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1 ( Original files are ~87GB on disk )
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Created
- Mar 13, 2024
- Updated
- Mar 14, 2024