Downloads · 30 days
21
3% of all-time downloads
distilroberta-squad
UKP-SQuARE/distilroberta-squad
distilroberta-squad is a question answering model from UKP-SQuARE. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as mit.
distilroberta-base fined-tuned on SQuAD (https://huggingface.co/datasets/squad)
All-time downloads
731
Public
Repo size
652 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin326 MB · 100%
At a glance
- Task
- Question Answering
- Library
- transformers
- License
- mit
- Model type
- roberta
- Access
- Public
- Created
- Jul 3, 2022
- Updated
- Jul 3, 2022
- SHA
- 583aaaed
Try a prompt
Datasets
Model card
From the Hugging Face model README
distilroberta-base fined-tuned on SQuAD (https://huggingface.co/datasets/squad)
Hyperparameters:
- epochs: 1
- lr: 1e-5
- train batch sie: 16
- optimizer: adamW
- lr_scheduler: linear
- num warming steps: 0
- max_length: 512
Results on the dev set:
- 'exact_match': 76.37653736991486
- 'f1': 84.5528918750732
It took 1h 20 min to train on Colab.
- Task
- Question Answering
- Library
- transformers
- Type
- roberta
- License
- mit
- Languages
- en
- Created
- Jul 3, 2022
- Updated
- Jul 3, 2022