Downloads · 30 days
557
1% of all-time downloads
bigbird-roberta-natural-questions
vasudevgupta/bigbird-roberta-natural-questions
bigbird-roberta-natural-questions is a question answering model from vasudevgupta. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as apache-2.0.
This checkpoint is obtained after training BigBirdForQuestionAnswering (with extra pooler head) on naturalquestions dataset for ~ 2 weeks on 2 K80 GPUs. Script for training can be found here: https://github.com/vasude…
All-time downloads
105K
Public
Repo size
7.4 GB
Likes
10
Public
Repo makeup
Click a slice to open those files.
.pt1.1 GB · 67%
At a glance
- Task
- Question Answering
- Library
- transformers
- License
- apache-2.0
- Model type
- big_bird
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- May 12, 2021
- SHA
- e073d287
Try a prompt
Datasets
Model card
From the Hugging Face model README
This checkpoint is obtained after training BigBirdForQuestionAnswering (with extra pooler head) on natural_questions dataset for ~ 2 weeks on 2 K80 GPUs. Script for training can be found here: https://github.com/vasudevgupta7/bigbird
| Exact Match | 47.44 |
|---|
Use this model just like any other model from 🤗Transformers
from transformers import BigBirdForQuestionAnswering
model_id = "vasudevgupta/bigbird-roberta-natural-questions"
model = BigBirdForQuestionAnswering.from_pretrained(model_id)
tokenizer = BigBirdTokenizer.from_pretrained(model_id)
In case you are interested in predicting category (null, long, short, yes, no) as well, use BigBirdForNaturalQuestions (instead of BigBirdForQuestionAnswering) from my training script.
- Task
- Question Answering
- Library
- transformers
- Type
- big_bird
- License
- apache-2.0
- Languages
- en
- Created
- Mar 2, 2022
- Updated
- May 12, 2021