Downloads · 30 days
14
0% of all-time downloads
bert-base-finnish-cased-squad2
TurkuNLP/bert-base-finnish-cased-squad2
bert-base-finnish-cased-squad2 is a question answering model from TurkuNLP. Use it when the input is a question plus a passage. It is set up for transformers.
This is the bert-base-finnish-cased-v1 model, fine-tuned using the Finnish SQuAD2.0 dataset. It's been trained on question-answer pairs, including unanswerable questions, for the task of Question Answering.
All-time downloads
5.8K
Public
Repo size
992 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin496 MB · 100%
At a glance
- Task
- Question Answering
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Jan 30, 2023
- Updated
- Jan 30, 2023
- SHA
- a5a94633
Datasets
Model card
From the Hugging Face model README
bert-base-finnish-cased-v1 for QA
This is the bert-base-finnish-cased-v1 model, fine-tuned using the Finnish SQuAD2.0 dataset. It's been trained on question-answer pairs, including unanswerable questions, for the task of Question Answering.
Overview
Language model: bert-base-finnish-v1
Language: Finnish
Downstream-task: Extractive QA
Training data: squad_v2_fi
Eval data: squad_v2_fi
Hyperparameters
batch_size = 12
n_epochs = 2
base_LM_model = "bert-base-finnish-cased-v1"
max_seq_len = 384
learning_rate = 3e-5
doc_stride=128
Performance
"exact": 68.2424,
"f1": 73.6607,
"HasAns_exact": 58.3290,
"HasAns_f1": 69.3629,
"HasAns_total": 5817,
"NoAns_exact": 77.8073,
"NoAns_f1": 77.8073,
"NoAns_total": 6029,
"samples": 12138,
"total": 11846
Comparison with other Finnish models
| model | F1 |
|---|---|
| TurkuNLP/bert-base-finnish-cased-squad2 | 73.66 |
| ilmariky/bert-base-finnish-cased-squad2-fi | 61.87 |
- Task
- Question Answering
- Library
- transformers
- Type
- bert
- Languages
- fi
- Created
- Jan 30, 2023
- Updated
- Jan 30, 2023