Downloads · 30 days
16
37% of all-time downloads
moecule-2x1.1b-m3
davzoku/moecule-2x1.1b-m3
moecule-2x1.1b-m3 is a machine learning model from davzoku. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
43
Public
Parameters
2B
3.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.9 GB · 100%
At a glance
- Model type
- moellama
- Access
- Public
- Created
- Feb 25, 2025
- Updated
- Feb 25, 2025
- SHA
- 73f63ac0
Model card
From the Hugging Face model README
python -m moetify.mix \
--output_dir ./moecule-2x1.1b-m3 \
--model_path jeff31415/TinyLlama-1.1B-1T-OpenOrca \
--modules mlp q_proj \
--ingredients \
SumayyaAli/tiny-llama-1.1b-chat-medical \
TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
- Type
- moellama
- Created
- Feb 25, 2025
- Updated
- Feb 25, 2025