Downloads · 30 days
14
2% of all-time downloads
microbert-indonesian-mx
lgessler/microbert-indonesian-mx
microbert-indonesian-mx is a feature extraction model from lgessler. Use it when you need embeddings to search or compare text. It is set up for transformers.
This is a MicroBERT model for Indonesian.
All-time downloads
711
Public
Repo size
12.1 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin6 MB · 96%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Dec 23, 2022
- Updated
- Dec 23, 2022
- SHA
- cd874a99
Try a prompt
Model card
From the Hugging Face model README
This is a MicroBERT model for Indonesian.
- Its suffix is -mx, which means that it was pretrained using supervision from masked language modeling and XPOS tagging.
- The unlabeled Indonesian data was taken from a June 2022 dump of Indonesian Wikipedia, downsampled to 1,439,772 tokens.
- The UD treebank UD_Indonesian-GSD, v2.10, totaling 122,021 tokens, was used for labeled data.
Please see the repository and the paper for more details.
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Languages
- ind
- Created
- Dec 23, 2022
- Updated
- Dec 23, 2022