Downloads · 30 days
3
5% of all-time downloads
FusionNet_7Bx2_MoE_14B-3.0bpw-h6-exl2
LoneStriker/FusionNet_7Bx2_MoE_14B-3.0bpw-h6-exl2
FusionNet_7Bx2_MoE_14B-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Fine-tuned model on English language using MoE method. The FusionNet is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B para…
All-time downloads
55
Public
Repo size
5.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Jan 14, 2024
- Updated
- Jan 14, 2024
- SHA
- d1c6ed01
Try a prompt
Model card
From the Hugging Face model README
FusionNet
Fine-tuned model on English language using MoE method.
Model description
The FusionNet is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy!
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Languages
- en
- Created
- Jan 14, 2024
- Updated
- Jan 14, 2024