Downloads · 30 days
5
0% of all-time downloads
cocodr-large-msmarco-idro-only
OpenMatch/cocodr-large-msmarco-idro-only
cocodr-large-msmarco-idro-only is a fill-mask model from OpenMatch. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This model has been pretrained on MS MARCO corpus and then finetuned on MS MARCO training data with implicit distributionally robust optimization (iDRO), following the approach described in the paper COCO-DR: Combatin…
All-time downloads
1.3K
Public
Repo size
2.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.3 GB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Oct 28, 2022
- Updated
- Oct 28, 2022
- SHA
- 1f594ce1
Try a prompt
Model card
From the Hugging Face model README
This model has been pretrained on MS MARCO corpus and then finetuned on MS MARCO training data with implicit distributionally robust optimization (iDRO), following the approach described in the paper COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning. The associated GitHub repository is available here https://github.com/OpenMatch/COCO-DR.
This model is trained with BERT-large as the backbone with 335M hyperparameters.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Created
- Oct 28, 2022
- Updated
- Oct 28, 2022