Downloads · 30 days
9
15% of all-time downloads
microbert-maltese-mxp
lgessler/microbert-maltese-mxp
microbert-maltese-mxp is a feature extraction model from lgessler. Use it when you need embeddings to search or compare text. It is set up for transformers.
All-time downloads
62
Public
Repo size
13.6 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin6.8 MB · 95%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Dec 23, 2022
- Updated
- Dec 23, 2022
- SHA
- de283476
Try a prompt
Model card
From the Hugging Face model README
This is a MicroBERT model for Maltese.
- Its suffix is -mxp, which means that it was pretrained using supervision from masked language modeling, XPOS tagging, and UD dependency parsing.
- The unlabeled Maltese data was taken from a February 2022 dump of Maltese Wikipedia, totaling 2,113,223 tokens.
- The UD treebank UD_Maltese-GSD, v2.9, totaling 44,162 tokens, was used for labeled data.
Please see the repository and the paper for more details.
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Languages
- mlt
- Created
- Dec 23, 2022
- Updated
- Dec 23, 2022