Downloads · 30 days
6
1% of all-time downloads
cocodr-base-msmarco-idro-only
OpenMatch/cocodr-base-msmarco-idro-only
cocodr-base-msmarco-idro-only is a feature extraction model from OpenMatch. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
This model has been pretrained on MS MARCO corpus and then finetuned on MS MARCO training data with implicit distributionally robust optimization (iDRO), following the approach described in the paper COCO-DR: Combatin…
All-time downloads
407
Public
Repo size
881 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin440 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Oct 27, 2022
- Updated
- Oct 27, 2022
- SHA
- 48029a8e
Model card
From the Hugging Face model README
This model has been pretrained on MS MARCO corpus and then finetuned on MS MARCO training data with implicit distributionally robust optimization (iDRO), following the approach described in the paper COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning. The associated GitHub repository is available here https://github.com/OpenMatch/COCO-DR.
This model is trained with BERT-base as the backbone with 110M hyperparameters.
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- License
- mit
- Created
- Oct 27, 2022
- Updated
- Oct 27, 2022