Downloads · 30 days
5
1% of all-time downloads
cocodr-large-msmarco-warmup
OpenMatch/cocodr-large-msmarco-warmup
cocodr-large-msmarco-warmup is a fill-mask model from OpenMatch. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This model has been pretrained on BEIR corpus then finetuned on MS MARCO with BM25 warmup only, following the approach described in the paper COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Co…
All-time downloads
351
Public
Repo size
2.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.3 GB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Oct 28, 2022
- Updated
- Oct 28, 2022
- SHA
- 172ad7c1
Try a prompt
Model card
From the Hugging Face model README
This model has been pretrained on BEIR corpus then finetuned on MS MARCO with BM25 warmup only, following the approach described in the paper COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning. The associated GitHub repository is available here https://github.com/OpenMatch/COCO-DR.
This model is trained with BERT-large as the backbone with 335M hyperparameters.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Created
- Oct 28, 2022
- Updated
- Oct 28, 2022