Downloads · 30 days
11
3% of all-time downloads
microbert-maltese-mx
lgessler/microbert-maltese-mx
microbert-maltese-mx is a feature extraction model from lgessler. Use it when you need embeddings to search or compare text. It is set up for transformers.
All-time downloads
396
Public
Repo size
13.6 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin6.8 MB · 95%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Dec 23, 2022
- Updated
- Dec 23, 2022
- SHA
- 3982b8ff
Try a prompt
Model card
From the Hugging Face model README
This is a MicroBERT model for Maltese.
- Its suffix is -mx, which means that it was pretrained using supervision from masked language modeling and XPOS tagging.
- The unlabeled Maltese data was taken from a February 2022 dump of Maltese Wikipedia, totaling 2,113,223 tokens.
- The UD treebank UD_Maltese-GSD, v2.9, totaling 44,162 tokens, was used for labeled data.
Please see the repository and the paper for more details.
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Languages
- mlt
- Created
- Dec 23, 2022
- Updated
- Dec 23, 2022