Downloads · 30 days
13
2% of all-time downloads
t5-base-msmarco-squad-query-generation-firstp-v2
jmvcoelho/t5-base-msmarco-squad-query-generation-firstp-v2
t5-base-msmarco-squad-query-generation-firstp-v2 is a machine learning model from jmvcoelho. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as wtfpl.
t5-base-msmarco-squad-query-generation-firstp-v2
All-time downloads
743
Public
Repo size
1.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin892 MB · 100%
At a glance
- Library
- transformers
- License
- wtfpl
- Model type
- t5
- Access
- Public
- Created
- Apr 5, 2023
- Updated
- Apr 5, 2023
- SHA
- de79d5e3
Model card
From the Hugging Face model README
Model
t5-base-msmarco-squad-query-generation-firstp-v2
Task: query generation Architecture: T5
Base model: t5-base
Note: This is supposed to be a baseline model.
Prompt:
"Generate Query: {document}. Query:"
Sequence length:
512 tokens
Training details
Hyperparameters
Batch size: 8;
Gradient acc: 8;
LR: 3e-4, linear scheduler, 400 warmup steps.
Data
Total: 252059 pairs (document, query)
From MARCO-V2: 165238 From SQuAD: 86821
The remaining queries from MARCO-V2 train split were not used.
Evaluation
This model is supposed to be used for data augmentation. Hence, meaningful evaluation will come from downstream tasks.
MARCO-V2 Dev1: BLEU: 0.105 ROUGE: 0.449
MARCO-V2 Dev2: BLEU: 0.171 ROUGE: 0.503
- Library
- transformers
- Type
- t5
- License
- wtfpl
- Languages
- en
- Created
- Apr 5, 2023
- Updated
- Apr 5, 2023