Downloads · 30 days
5
2% of all-time downloads
bert-base-minimoe-4L-384H
GeneZC/bert-base-minimoe-4L-384H
bert-base-minimoe-4L-384H is a machine learning model from GeneZC. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
minimoe-4L-384H distilled from bert-base-uncased on Wikipedia.
All-time downloads
211
Public
Repo size
135 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin135 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- May 30, 2023
- Updated
- May 31, 2023
- SHA
- f7e1fcfa
Datasets
Model card
From the Hugging Face model README
Model details
minimoe-4L-384H distilled from bert-base-uncased on Wikipedia.
Repository: https://github.com/GeneZC/MiniMoE arXiv: https://arxiv.org/abs/2305.12129
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Created
- May 30, 2023
- Updated
- May 31, 2023