Downloads · 30 days
23
37% of all-time downloads
MoE-Test-4x7b
athirdpath/MoE-Test-4x7b
MoE-Test-4x7b is a text generation model from athirdpath. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
62
Public
Parameters
24.2B
48.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors48.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024
- SHA
- 7a7c0b85
Try a prompt
Model card
From the Hugging Face model README
I'm back! :D
A mergekit made MoE with all Apache licenses, so this lil guy is commercially usable, unlike my prior models.
Models used:
- cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser
- lvkaokao/mistral-7b-finetuned-orca-dpo-v2
- Herman555/Hexoteric-AshhLimaRP-Mistral-7B-GGUF
- jondurbin/bagel-dpo-7b-v0.1
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Created
- Jan 16, 2024
- Updated
- Jan 16, 2024