Downloads · 30 days
6.4K
3% of all-time downloads
xlm-roberta-longformer-base-16384
severinsimmler/xlm-roberta-longformer-base-16384
xlm-roberta-longformer-base-16384 is a feature extraction model from severinsimmler. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
⚠️ This is just the PyTorch version of hyperonym/xlm-roberta-longformer-base-16384 without any modifications.
All-time downloads
248K
Public
Parameters
311M
2.5 GB on disk
Likes
29
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 50%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- longformer
- Access
- Public
- Created
- Apr 20, 2023
- Updated
- Jul 10, 2023
- SHA
- 859ef843
Model card
From the Hugging Face model README
xlm-roberta-longformer-base-16384
⚠️ This is just the PyTorch version of hyperonym/xlm-roberta-longformer-base-16384 without any modifications.
xlm-roberta-longformer is a multilingual Longformer initialized with XLM-RoBERTa's weights without further pretraining. It is intended to be fine-tuned on a downstream task.
The notebook for replicating the model is available on GitHub: https://github.com/hyperonym/dirge/blob/master/models/xlm-roberta-longformer/convert.ipynb
- Task
- Feature Extraction
- Library
- transformers
- Type
- longformer
- License
- mit
- Languages
- multilingual, af, am, ar, as, az
- Hf Inference
- live
- Created
- Apr 20, 2023
- Updated
- Jul 10, 2023