Downloads · 30 days
41
0% of all-time downloads
Luyu/bert-base-mdoc-bm25
bert-base-mdoc-bm25 is a text classification model from Luyu. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
A text reranker trained for BM25 retriever on MS MARCO document dataset.
Downloads · 30 days
41
0% of all-time downloads
All-time downloads
65.6K
Public
Repo size
1.3 GB
Likes
1
Public
Click a slice to open those files.
.bin438 MB · 50%
From the Hugging Face model README
A text reranker trained for BM25 retriever on MS MARCO document dataset.
It is possible to work with other retrievers like but using aligned BM25 works the best.
We used anserini toolkit's BM25 implementation and indexed with tuned parameters (k1=3.8, b=0.87) following this instruction.
See our project repo page.
MRR @10: 0.423 on Dev.
@inproceedings{gao2021lce,
title={Rethink Training of BERT Rerankers in Multi-Stage Retrieval Pipeline},
author={Luyu Gao and Zhuyun Dai and Jamie Callan},
year={2021},
booktitle={The 43rd European Conference On Information Retrieval (ECIR)},
}