Downloads · 30 days
6
18% of all-time downloads
FiD-3B-NQ
wyu1/FiD-3B-NQ
FiD-3B-NQ is a machine learning model from wyu1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-4.0.
-- This is the model checkpoint of FiD [2], based on the T5 (with 3B parameters) and trained on the NQ dataset [1].
All-time downloads
34
Public
Repo size
22.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin11.4 GB · 100%
At a glance
- Library
- transformers
- License
- cc-by-4.0
- Model type
- t5
- Access
- Public
- Created
- Mar 28, 2023
- Updated
- Mar 28, 2023
- SHA
- 4838e2db
Model card
From the Hugging Face model README
FiD model trained on NQ
-- This is the model checkpoint of FiD [2], based on the T5 (with 3B parameters) and trained on the NQ dataset [1].
-- Hyperparameters: 8 x 40GB A100 GPUs; batch size 8; AdamW; LR 3e-5; 30000 steps
References:
[1] Natural Questions: A Benchmark for Question Answering Research. TACL 2019.
[2] Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering. EACL 2021.
Model performance
We evaluate it on the NQ dataset, the EM score is 50.6 on the test set.
<a href="https://huggingface.co/exbert/?model=bert-base-uncased"> <img width="300px" src="https://cdn-media.huggingface.co/exbert/button.png"> </a>- Library
- transformers
- Type
- t5
- License
- cc-by-4.0
- Created
- Mar 28, 2023
- Updated
- Mar 28, 2023