Downloads · 30 days
15
13% of all-time downloads
moecule-3x3b-m5
davzoku/moecule-3x3b-m5
moecule-3x3b-m5 is a machine learning model from davzoku. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
118
Public
Parameters
8.4B
16.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.7 GB · 100%
At a glance
- Model type
- moellama
- Access
- Public
- Created
- Mar 17, 2025
- Updated
- Mar 19, 2025
- SHA
- a05e6b8c
Model card
From the Hugging Face model README
python -m moetify.mix \
--output_dir ./moecule-3x3b-m5 \
--model_path unsloth/Llama-3.2-3B-Instruct \
--modules mlp q_proj \
--ingredients \
unsloth/Llama-3.2-3B-Instruct \
unsloth/Llama-3.2-3B-Instruct \
unsloth/Llama-3.2-3B-Instruct
- Type
- moellama
- Created
- Mar 17, 2025
- Updated
- Mar 19, 2025