Downloads · 30 days
7
13% of all-time downloads
FusionNet_7Bx2_MoE_14B-8.0bpw-h8-exl2
LoneStriker/FusionNet_7Bx2_MoE_14B-8.0bpw-h8-exl2
FusionNet_7Bx2_MoE_14B-8.0bpw-h8-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Fine-tuned model on English language using MoE method. The FusionNet is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B para…
All-time downloads
54
Public
Repo size
13 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors13 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Jan 14, 2024
- Updated
- Jan 14, 2024
- SHA
- 8436f337
Try a prompt
Model card
From the Hugging Face model README
FusionNet
Fine-tuned model on English language using MoE method.
Model description
The FusionNet is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy!
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Languages
- en
- Created
- Jan 14, 2024
- Updated
- Jan 14, 2024