Downloads · 30 days
14
2% of all-time downloads
LiBERTus-base
ljvmiranda921/LiBERTus-base
LiBERTus-base is a fill-mask model from ljvmiranda921. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
Submission to Task 1 (Constrained) of the SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages. The system is built by first pretraining a multilingual language model and then fine…
All-time downloads
708
Public
Parameters
126M
2.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors504 MB · 96%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- roberta
- Access
- Public
- Created
- Nov 16, 2023
- Updated
- Mar 16, 2024
- SHA
- ebc0223b
Try a prompt
Model card
From the Hugging Face model README
LiBERTus-base
Submission to Task 1 (Constrained) of the SIGTYP 2024 Shared Task on Word
Embedding Evaluation for Ancient and Historical
Languages. The system is built by
first pretraining a multilingual language model and then finetuning it for a
downstream task. The submission for Phase 1 and 2 of the Shared Task can be
found in the submission_p1 and submission_p2 directories.
If you're using this model, please cite:
@inproceedings{miranda-2024-allen,
title = "{A}llen Institute for {AI} @ {SIGTYP} 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages",
author = "Miranda, Lester James",
booktitle = "Proceedings of the 6th Workshop on Research in Computational Linguistic Typology and Multilingual NLP",
month = mar,
year = "2024",
address = "St. Julian's, Malta",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.sigtyp-1.18",
pages = "151--159",
}
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- License
- mit
- Created
- Nov 16, 2023
- Updated
- Mar 16, 2024