Downloads · 30 days
6
1% of all-time downloads
kornesh/xlm-roberta-base
xlm-roberta-base is a feature extraction model from kornesh. Use it when you need embeddings to search or compare text. It is set up for transformers.
Downloads · 30 days
6
1% of all-time downloads
All-time downloads
1K
Public
Repo size
1.1 GB
Likes
1
Public
Click a slice to open those files.
.h51.1 GB · 99%
From the Hugging Face model README
Converted for Tensorflow
!pip install transformers sentencepiece
from transformers import TFAutoModel, AutoTokenizer
name = "xlm-roberta-base"
model = TFAutoModel.from_pretrained(name, from_pt=True)
tokenizer = AutoTokenizer.from_pretrained(name)
model.save_pretrained("local-xlm-roberta-base")
tokenizer.save_pretrained("local-xlm-roberta-base")