Downloads · 30 days
86
0% of all-time downloads
roberta-base-squad
thatdramebaazguy/roberta-base-squad
roberta-base-squad is a question answering model from thatdramebaazguy. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as cc-by-4.0.
Objective: This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.
All-time downloads
655K
Public
Repo size
2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.h5496 MB · 33%
At a glance
- Task
- Question Answering
- Library
- transformers
- License
- cc-by-4.0
- Model type
- roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jul 1, 2022
- SHA
- a7a26fd5
Try a prompt
Datasets
Model card
From the Hugging Face model README
roberta-base + SQuAD QA
Objective: This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.
model_name = "thatdramebaazguy/roberta-base-squad"
pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")
Overview
Language model: roberta-base
Language: English
Downstream-task: QA
Training data: SQuADv1
Eval data: SQuAD
Infrastructure: 2x Tesla v100
Code: See example
Hyperparameters
Num examples = 88567
Num Epochs = 10
Instantaneous batch size per device = 32
Total train batch size (w. parallel, distributed & accumulation) = 64
Performance
Eval on SQuADv1
- epoch = 10.0
- eval_samples = 10790
- exact_match = 83.6045
- f1 = 91.1709
Eval on MoviesQA
- eval_samples = 5032
- exact_match = 51.6494
- f1 = 68.2615
Github Repo:
- Task
- Question Answering
- Library
- transformers
- Type
- roberta
- License
- cc-by-4.0
- Created
- Mar 2, 2022
- Updated
- Jul 1, 2022