Downloads · 30 days
4.2K
5% of all-time downloads
crosloengual-bert
EMBEDDIA/crosloengual-bert
crosloengual-bert is a fill-mask model from EMBEDDIA. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as cc-by-4.0.
CroSloEngual BERT is a trilingual model, using bert-base architecture, trained on Croatian, Slovenian, and English corpora. Focusing on three languages, the model performs better than multilingual BERT, while still of…
All-time downloads
84.5K
Public
Repo size
1.5 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.bin499 MB · 50%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- cc-by-4.0
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- May 18, 2021
- SHA
- 750255b6
Model card
From the Hugging Face model README
CroSloEngual BERT
CroSloEngual BERT is a trilingual model, using bert-base architecture, trained on Croatian, Slovenian, and English corpora. Focusing on three languages, the model performs better than multilingual BERT, while still offering an option for cross-lingual knowledge transfer, which a monolingual model wouldn't.
Evaluation is presented in our article:
@Inproceedings{ulcar-robnik2020finest,
author = "Ulčar, M. and Robnik-Šikonja, M.",
year = 2020,
title = "{FinEst BERT} and {CroSloEngual BERT}: less is more in multilingual models",
editor = "Sojka, P and Kopeček, I and Pala, K and Horák, A",
booktitle = "Text, Speech, and Dialogue {TSD 2020}",
series = "Lecture Notes in Computer Science",
volume = 12284,
publisher = "Springer",
url = "https://doi.org/10.1007/978-3-030-58323-1_11",
}
The preprint is available at arxiv.org/abs/2006.07890.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- cc-by-4.0
- Languages
- hr, sl, en, multilingual
- Hf Inference
- live
- Created
- Mar 2, 2022
- Updated
- May 18, 2021