Downloads · 30 days
31
21% of all-time downloads
tmoe-exp-v1
ehristoforu/tmoe-exp-v1
tmoe-exp-v1 is a other model from ehristoforu. Use it for the other task on the model card, and read the license before you ship it in a product. It is set up for transformers.
All-time downloads
146
Public
Parameters
4.9B
9.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors9.9 GB · 100%
At a glance
- Task
- other
- Library
- transformers
- Model type
- mixtral
- Access
- Public
- Created
- Jan 24, 2025
- Updated
- Jan 24, 2025
- SHA
- bf91ab9c
Model card
From the Hugging Face model README
This is fully exp model!
base_model: beomi/EXAONE-3.5-2.4B-Instruct-Llamafied
gate_mode: random
architecture: mixtral
experts_per_token: 2
dtype: bfloat16
experts:
- source_model: beomi/EXAONE-3.5-2.4B-Instruct-Llamafied
- source_model: unsloth/Phi-3.5-mini-instruct
- Task
- other
- Library
- transformers
- Type
- mixtral
- Created
- Jan 24, 2025
- Updated
- Jan 24, 2025