Downloads · 30 days
8
1% of all-time downloads
co-condenser-large-msmarco
OpenMatch/co-condenser-large-msmarco
co-condenser-large-msmarco is a fill-mask model from OpenMatch. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This model has been pretrained on MS MARCO passages first, then fine-tuned on the MS MARCO training set following the approach described in the paper Unsupervised Corpus Aware Language Model Pre-training for Dense Pas…
All-time downloads
1.2K
Public
Repo size
2.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.3 GB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Oct 28, 2022
- Updated
- Nov 5, 2022
- SHA
- 176bd962
Try a prompt
Model card
From the Hugging Face model README
This model has been pretrained on MS MARCO passages first, then fine-tuned on the MS MARCO training set following the approach described in the paper Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval. The model can be used to reproduce the experimental results associated GitHub repository is available here https://github.com/OpenMatch/COCO-DR.
This model is trained with BERT-large as the backbone with 335M hyperparameters.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Created
- Oct 28, 2022
- Updated
- Nov 5, 2022