Downloads · 30 days
23
5% of all-time downloads
llama3-2x8b-MoE-41k-experiment1
nisten/llama3-2x8b-MoE-41k-experiment1
llama3-2x8b-MoE-41k-experiment1 is a text generation model from nisten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
Meow. This an experimental mixture of expert model with just 2 experts based on Llama 3 Instruct plain in combo with finetune. Specifically, it is built on top of the Meta-Llama-3-8B-Instruct model and finetune is tra…
All-time downloads
452
Public
Parameters
13.7B
27.3 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors27.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- mixtral
- Access
- Public
- Created
- Apr 25, 2024
- Updated
- Apr 26, 2024
- SHA
- 93dc9537
Try a prompt
Base models
Model card
From the Hugging Face model README
Meow. This an experimental mixture of expert model with just 2 experts based on Llama 3 Instruct plain in combo with finetune. Specifically, it is built on top of the Meta-Llama-3-8B-Instruct model and finetune is trained on Argilla Capybara dataset.
[!TIP]Experimental mixture of 2 experts Llama3-8b-Instruct
Built with Llama 3
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- llama3
- Languages
- en
- Created
- Apr 25, 2024
- Updated
- Apr 26, 2024