Downloads · 30 days
6
9% of all-time downloads
WizardLM-2-4x7B-MoE-exl2-5_0bpw
Skylaude/WizardLM-2-4x7B-MoE-exl2-5_0bpw
WizardLM-2-4x7B-MoE-exl2-5_0bpw is a text generation model from Skylaude. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a quantized version of WizardLM-2-4x7B-MoE an experimental MoE model made with Mergekit. Quantization was done using version 0.0.18 of ExLlamaV2.
All-time downloads
64
Public
Repo size
15.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Apr 17, 2024
- Updated
- Apr 18, 2024
- SHA
- dd3ddaf5
Try a prompt
Model card
From the Hugging Face model README
WizardLM-2-4x7B-MoE-exl2-5_0bpw
This is a quantized version of WizardLM-2-4x7B-MoE an experimental MoE model made with Mergekit. Quantization was done using version 0.0.18 of ExLlamaV2.
Please be sure to set experts per token to 4 for the best results! Context length should be the same as Mistral-7B-Instruct-v0.1 (8k tokens). For instruction templates, Vicuna-v1.1 is recommended.
For more information see the original repository.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Created
- Apr 17, 2024
- Updated
- Apr 18, 2024