Downloads · 30 days
11
4% of all-time downloads
wiki-text-8-4-multi-dpr2-query-encoder
castorini/wiki-text-8-4-multi-dpr2-query-encoder
wiki-text-8-4-multi-dpr2-query-encoder is a feature extraction model from castorini. Use it when you need embeddings to search or compare text. It is set up for transformers.
Dense passage retriever (DPR) is a dense retrieval method described in the following paper:
All-time downloads
255
Public
Repo size
438 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.msgpack438 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Jan 4, 2023
- Updated
- Jan 5, 2023
- SHA
- d290617b
Model card
From the Hugging Face model README
Dense passage retriever (DPR) is a dense retrieval method described in the following paper:
Vladimir Karpukhin, Barlas Oğuz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, Wen-tau Yih. Dense Passage Retrieval for Open-Domain Question Answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6769-6781, 2020.
We have trained our own DPR models with our Wikipedia corpus variants using the Tevatron library.
Our own efforts are described in the paper entitled:
Pre-Processing Matters! Improved Wikipedia Corpora for Open-Domain Question Answering.
This is the query encoder portion of a 2nd iteration DPR model for the wiki-text-8-4 corpus variant trained on the amalgamation of the NQ, TriviaQA, WQ, and CuratedTREC datasets.
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Created
- Jan 4, 2023
- Updated
- Jan 5, 2023