Downloads · 30 days
10
3% of all-time downloads
master-base-pretrained-wiki
lx865712528/master-base-pretrained-wiki
master-base-pretrained-wiki is a feature extraction model from lx865712528. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
Paper: https://arxiv.org/abs/2212.07841.
All-time downloads
356
Public
Repo size
2.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt1.7 GB · 80%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Jul 3, 2023
- Updated
- Jul 3, 2023
- SHA
- 932f4d64
Datasets
Model card
From the Hugging Face model README
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Paper: https://arxiv.org/abs/2212.07841.
Code: https://github.com/microsoft/SimXNS/tree/main/MASTER.
Overview
This is the checkpoint after pretraining on the NQ, TQ, WQ and Squad's Wikipedia corpus. You may use this checkpoint as the initialization for finetuning.
Useage
To load this checkpoint for initialization, you may follow:
from transformers import AutoModel
model = AutoModel.from_pretrained('lx865712528/master-base-pretrained-wiki')
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- en
- Created
- Jul 3, 2023
- Updated
- Jul 3, 2023