Downloads · 30 days
5
1% of all-time downloads
brutusxu/distilbert-base-cross-encoder-first-p
distilbert-base-cross-encoder-first-p is a text classification model from brutusxu. Use it when you need a label for a piece of text. It is set up for transformers.
distilbert-base-uncased trained on MSMARCO Document Reranking task,
Downloads · 30 days
5
1% of all-time downloads
All-time downloads
589
Public
Repo size
536 MB
Likes
0
Public
Click a slice to open those files.
.bin268 MB · 100%
From the Hugging Face model README
distilbert-base-uncased trained on MSMARCO Document Reranking task,
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained('brutusxu/distilbert-base-cross-encoder-first-p')
model = AutoModelForSequenceClassification.from_pretrained('brutusxu/distilbert-base-cross-encoder-first-p')
query = 'I love New York'
document = 'I like New York'
input = '<P>' + query + tokenizer.sep_token + '<Q>' + document
tokenized_input = tokenizer(input, return_tensors='pt')
ranking_score = model(**tokenized_input)
on MSMARCO Document Reranking w. top-100 documents from BM25
MRR@10: 0.373
MRR@100: 0.381
nDCG@10: 0.442
nDCG@10: 0.475