Downloads · 30 days
12
3% of all-time downloads
master-base-pretrained-msmarco
lx865712528/master-base-pretrained-msmarco
master-base-pretrained-msmarco is a feature extraction model from lx865712528. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
Paper: https://arxiv.org/abs/2212.07841.
All-time downloads
397
Public
Repo size
2.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt1.7 GB · 80%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Jul 3, 2023
- Updated
- Jul 3, 2023
- SHA
- 57392725
Datasets
Model card
From the Hugging Face model README
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Paper: https://arxiv.org/abs/2212.07841.
Code: https://github.com/microsoft/SimXNS/tree/main/MASTER.
Overview
This is the checkpoint after pretraining on the MS-MARCO corpus. You may use this checkpoint as the initialization for finetuning.
Useage
To load this checkpoint for initialization, you may follow:
from transformers import AutoModel
model = AutoModel.from_pretrained('lx865712528/master-base-pretrained-msmarco')
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- en
- Created
- Jul 3, 2023
- Updated
- Jul 3, 2023