Downloads · 30 days
8
2% of all-time downloads
colbert-distilbert-margin_mse-T2-msmarco-encoder-only
LilaBoualili/colbert-distilbert-margin_mse-T2-msmarco-encoder-only
colbert-distilbert-margin_mse-T2-msmarco-encoder-only is a feature extraction model from LilaBoualili. Use it when you need embeddings to search or compare text. It is set up for transformers.
We provide the encoder model of the complete retrieval trained DistilBert-based ColBERT model. This model is trained with Margin-MSE using a 3 teacher BERTCat (concatenated BERT scoring) ensemble on MSMARCO-Passage, f…
All-time downloads
342
Public
Repo size
531 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin265 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- distilbert
- Access
- Public
- Created
- Apr 4, 2023
- Updated
- Apr 4, 2023
- SHA
- ac9f6bf9
Datasets
Model card
From the Hugging Face model README
Margin-MSE Trained ColBERT encoder model only
We provide the encoder model of the complete retrieval trained DistilBert-based ColBERT model. This model is trained with Margin-MSE using a 3 teacher BERT_Cat (concatenated BERT scoring) ensemble on MSMARCO-Passage, for more details check the full model card.
This encoder-only model is used as the oracle for distilling term topic embeddings in our ECIR'23 paper.
- Task
- Feature Extraction
- Library
- transformers
- Type
- distilbert
- Languages
- en
- Created
- Apr 4, 2023
- Updated
- Apr 4, 2023