Downloads · 30 days
26
0% of all-time downloads
sebastian-hofstaetter/colberter-128-32-msmarco
colberter-128-32-msmarco is a machine learning model from sebastian-hofstaetter. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
If you want to know more about our ColBERTer architecture check out our paper: https://arxiv.org/abs/2203.13088 🎉
Downloads · 30 days
26
0% of all-time downloads
All-time downloads
5.3K
Public
Repo size
532 MB
Likes
2
Public
Click a slice to open those files.
.bin266 MB · 100%
From the Hugging Face model README
If you want to know more about our ColBERTer architecture check out our paper: https://arxiv.org/abs/2203.13088 🎉
For more information, source code, and a minimal usage example please visit: https://github.com/sebastian-hofstaetter/colberter
The model is only trained on english text.
The model inherits social biases from both DistilBERT and MSMARCO.
The model is only trained on relatively short passages of MSMARCO (avg. 60 words length), so it might struggle with longer text.
If you use our model checkpoint please cite our work as:
@article{Hofstaetter2022_colberter,
author = {Sebastian Hofst{\"a}tter and Omar Khattab and Sophia Althammer and Mete Sertkan and Allan Hanbury},
title = {Introducing Neural Bag of Whole-Words with ColBERTer: Contextualized Late Interactions using Enhanced Reduction},
publisher = {arXiv},
url = {https://arxiv.org/abs/2203.13088},
doi = {10.48550/ARXIV.2203.13088},
year = {2022},
}