Downloads · 30 days
9
2% of all-time downloads
cocodr-base-msmarco-warmup
OpenMatch/cocodr-base-msmarco-warmup
cocodr-base-msmarco-warmup is a fill-mask model from OpenMatch. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
All-time downloads
403
Public
Repo size
881 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin440 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Nov 20, 2022
- Updated
- Nov 20, 2022
- SHA
- 26d9fbd8
Try a prompt
Model card
From the Hugging Face model README
license: mit
This model has been pretrained on BEIR corpus then finetuned on MS MARCO with BM25 warmup only, following the approach described in the paper COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning. The associated GitHub repository is available here https://github.com/OpenMatch/COCO-DR.
This model is trained with BERT-base as the backbone with 110M hyperparameters.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Created
- Nov 20, 2022
- Updated
- Nov 20, 2022