Downloads · 30 days
16
3% of all-time downloads
FiD-TQA
wyu1/FiD-TQA
FiD-TQA is a machine learning model from wyu1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-4.0.
-- This is the model checkpoint of FiD [2], based on the T5 large (with 770M parameters) and trained on the TriviaQA dataset [1].
All-time downloads
573
Public
Repo size
5.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin3 GB · 100%
At a glance
- Library
- transformers
- License
- cc-by-4.0
- Model type
- t5
- Access
- Public
- Created
- Aug 19, 2022
- Updated
- Aug 25, 2022
- SHA
- 9611c20a
Model card
From the Hugging Face model README
FiD model trained on TQA
-- This is the model checkpoint of FiD [2], based on the T5 large (with 770M parameters) and trained on the TriviaQA dataset [1].
-- Hyperparameters: 8 x 40GB A100 GPUs; batch size 8; AdamW; LR 3e-5; 30000 steps
References:
[1] TriviaQA: A Large Scale Dataset for Reading Comprehension and Question Answering. ACL 2017
[2] Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering. EACL 2021.
Model performance
We evaluate it on the TriviaQA dataset, the EM score is 68.5 (0.8 higher than the original performance reported in the paper).
<a href="https://huggingface.co/exbert/?model=bert-base-uncased"> <img width="300px" src="https://cdn-media.huggingface.co/exbert/button.png"> </a> --- license: cc-by-4.0 ---- Library
- transformers
- Type
- t5
- License
- cc-by-4.0
- Created
- Aug 19, 2022
- Updated
- Aug 25, 2022