Downloads · 30 days
53
5% of all-time downloads
bert_medieval_multilingual
magistermilitum/bert_medieval_multilingual
bert_medieval_multilingual is a fill-mask model from magistermilitum. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This is a Fine-tuned version of the multilingual Bert model on medieval texts. The model is intended to be used as a fondation for other ML tasks on NLP and HTR environments.
All-time downloads
1K
Public
Repo size
1.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin712 MB · 99%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Dec 24, 2023
- Updated
- Mar 19, 2024
- SHA
- 749c6778
Try a prompt
Model card
From the Hugging Face model README
Model Details
This is a Fine-tuned version of the multilingual Bert model on medieval texts. The model is intended to be used as a fondation for other ML tasks on NLP and HTR environments.
The train dataset entails 650M of tokens coming from texts on classical and medieval latin; old french and old Spanish from a period ranging from 5th BC to 16th centuries.
Several big corpora were cleaned and transformed to be used during the training process :
| dataset | size | Lang | dates |
|---|---|---|---|
| CC100 [1] | 3,2Gb | la | 5th BC - 18th |
| Corpus Corporum [2] | 3,0Gb | la | 5th BC - 16th |
| CEMA [3] | 320Mb | la+fro | 9th - 15th |
| HOME-Alcar [4] | 38Mb | la+fro | 12th - 15th |
| BFM [5] | 34Mb | fro | 13th - 15th |
| AND [6] | 19Mb | fro | 13th - 15th |
| CODEA [7] | 13Mb | spa | 12th - 16th |
| ~6,5Gb | |||
| 650M tokens (4,5Gb)* |
- A significant overlapped quantity of text was detected across the corpora, specially on medieval collections. Besides, synthetic text ("Lorem ipsum dolorem...") was iteratively deleted.
[1] CC-NET Repository : https://huggingface.co/datasets/cc100
[2] Repositorium operum lationorum apud universitatem Turicensem : https://mlat.uzh.ch/
[3] Cartae Europae Medii Aevi (5th-15th c.) : https://cema.lamop.fr/
[4] History of Medieval Europe : https://doi.org/10.5281/zenodo.5600884
[5] Base du Français Médieval : https://txm-bfm.huma-num.fr/txm/
[6] Anglo-Normand Dictionary : https://anglo-norman.net/
[7] Corpus de Docuemntos Españoles anteriores a 1900: https://www.corpuscodea.es/
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- la, fr, es
- Created
- Dec 24, 2023
- Updated
- Mar 19, 2024