Downloads · 30 days
22
20% of all-time downloads
Wizard-Kun-Lake_3x7B-MoE
WesPro/Wizard-Kun-Lake_3x7B-MoE
Wizard-Kun-Lake_3x7B-MoE is a text generation model from WesPro. Use it when you need the model to write or continue text. It is set up for transformers.
This a 3x7B MoE model that I made out of some RP models I liked and I also applied a small lora I made myself to one of the experts. You can find a Q5KM GGUF version here : https://huggingface.co/WesPro/Wizard-Kun-Lak…
All-time downloads
108
Public
Parameters
18.5B
37 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors37 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mixtral
- Access
- Public
- Created
- Apr 18, 2024
- Updated
- Apr 20, 2024
- SHA
- d8113b01
Try a prompt
Model card
From the Hugging Face model README
This a 3x7B MoE model that I made out of some RP models I liked and I also applied a small lora I made myself to one of the experts. You can find a Q5_K_M GGUF version here : https://huggingface.co/WesPro/Wizard-Kun-Lake_3x7B-MoE_Q5_K_M.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- Created
- Apr 18, 2024
- Updated
- Apr 20, 2024