Downloads · 30 days
33
6% of all-time downloads
Sem-mmmBERT
robvanderg/Sem-mmmBERT
Sem-mmmBERT is a feature extraction model from robvanderg. Use it when you need embeddings to search or compare text. It is set up for transformers.
This is the SemEval MaChAmp Multitask Multilingual BERT model. This model is retrained from mBERT (https://huggingface.co/bert-base-multilingual-cased).
All-time downloads
515
Public
Repo size
1.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin711 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Mar 28, 2022
- Updated
- Mar 28, 2022
- SHA
- 4229c7a4
Model card
From the Hugging Face model README
Sem-mmmBERT
This is the SemEval MaChAmp Multitask Multilingual BERT model. This model is retrained from mBERT (https://huggingface.co/bert-base-multilingual-cased).
The retraining is done based on all SemEval 2022 tasks that are text based, and have annotation on the word, sentence or paragraph level. The retraining is done with MaChAmp (https://machamp-nlp.github.io/), a toolkit focusing on multi-task learning for NLP. More information can be found in the paper (which should be released when the SemEval proceedings are online).
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Languages
- multilingual
- Created
- Mar 28, 2022
- Updated
- Mar 28, 2022