Downloads · 30 days
6
9% of all-time downloads
nishantyadav/emb_crossenc_msmarco_teacher_2_bert_base
emb_crossenc_msmarco_teacher_2_bert_base is a text classification model from nishantyadav. Use it when you need a label for a piece of text. It is set up for transformers.
This is a cross-encoder model with dot-product based scoring mechanism trained on MS-MARCO dataset. The parameters of the cross-encoder are initialized using bert-base-uncased. This model is used as a teacher model fo…
Downloads · 30 days
6
9% of all-time downloads
All-time downloads
66
Public
Repo size
876 MB
Likes
0
Public
Click a slice to open those files.
.bin438 MB · 100%
From the Hugging Face model README
This is a cross-encoder model with dot-product based scoring mechanism trained on MS-MARCO dataset. The parameters of the cross-encoder are initialized using bert-base-uncased. This model is used as a teacher model for training a MiniLM-based cross-encoder model which is used in experiments of our EMNLP 2023 and ICLR 2024 papers.
See our EMNLP 2022 paper titled "Efficient Nearest Neighbor Search for Cross-Encoder Models using Matrix Factorization" for more details on the dot-product based scoring mechanism.