Downloads · 30 days
11
0% of all-time downloads
mirror-roberta-base-sentence
cambridgeltl/mirror-roberta-base-sentence
mirror-roberta-base-sentence is a feature extraction model from cambridgeltl. Use it when you need embeddings to search or compare text. It is set up for transformers.
All-time downloads
5.7K
Public
Repo size
997 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin499 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Sep 19, 2021
- SHA
- 3689dff4
Model card
From the Hugging Face model README
language: en
tags:
- sentence-embeddings
- sentence-similarity
cambridgeltl/mirror-roberta-base-sentence
An unsupervised sentence encoder proposed by Liu et al. (2021). The model is trained with unlabelled raw sentences, using roberta-base as the base model. Please use [CLS] (before pooler) as the representation of the input.
Note the model does not replicate the exact numbers in the paper since the reported numbers in the paper are average of three runs.
Citation
@inproceedings{
liu2021fast,
title={Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders},
author={Liu, Fangyu and Vuli{\'c}, Ivan and Korhonen, Anna and Collier, Nigel},
booktitle={EMNLP 2021},
year={2021}
}
- Task
- Feature Extraction
- Library
- transformers
- Type
- roberta
- Created
- Mar 2, 2022
- Updated
- Sep 19, 2021