Downloads · 30 days
16
2% of all-time downloads
xlm-roberta-est-qa
anukaver/xlm-roberta-est-qa
xlm-roberta-est-qa is a question answering model from anukaver. Use it when the input is a question plus a passage. It is set up for transformers.
This is a question answering model based on XLM-Roberta base model. It is fine-tuned subsequentially on: 1. English SQuAD v1.1 2. SQuAD v1.1 translated into Estonian 3. Small native Estonian dataset (800 samples)
All-time downloads
869
Public
Repo size
2.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.1 GB · 100%
At a glance
- Task
- Question Answering
- Library
- transformers
- Model type
- xlm-roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Apr 27, 2021
- SHA
- 31a79924
Try a prompt
Datasets
Model card
From the Hugging Face model README
Question answering model for Estonian
This is a question answering model based on XLM-Roberta base model. It is fine-tuned subsequentially on:
- English SQuAD v1.1
- SQuAD v1.1 translated into Estonian
- Small native Estonian dataset (800 samples)
The model has retained good multilingual properties and can be used for extractive QA tasks in all languages included in XLM-Roberta. The performance is best in the fine-tuning languages of Estonian and English.
| Tested on | F1 | EM |
|---|---|---|
| EstQA test set | 82.4 | 75.3 |
| SQuAD v1.1 dev set | 86.9 | 77.9 |
The Estonian dataset used for fine-tuning and validating results is available in https://huggingface.co/datasets/anukaver/EstQA/ (version 1.0)
- Task
- Question Answering
- Library
- transformers
- Type
- xlm-roberta
- Created
- Mar 2, 2022
- Updated
- Apr 27, 2021