Downloads · 30 days
26
1% of all-time downloads
duot5-3b-msmarco
castorini/duot5-3b-msmarco
duot5-3b-msmarco is a feature extraction model from castorini. Use it when you need embeddings to search or compare text. It is set up for transformers.
This model is a T5-3B reranker, initialized with our pointwise ranker, castorini/monot5-3b-msmarco, and finetuned on the MS MARCO passage dataset for 50K steps (or 5 epochs) on the pairwise reranking task.
All-time downloads
3.7K
Public
Repo size
22.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin11.4 GB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- May 28, 2021
- SHA
- 72c53160
Model card
From the Hugging Face model README
This model is a T5-3B reranker, initialized with our pointwise ranker, castorini/monot5-3b-msmarco, and finetuned on the MS MARCO passage dataset for 50K steps (or 5 epochs) on the pairwise reranking task.
For more details on how to use it, check pygaggle.ai!
Paper describing the model: The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models
- Task
- Feature Extraction
- Library
- transformers
- Type
- t5
- Created
- Mar 2, 2022
- Updated
- May 28, 2021