Downloads · 30 days
207
3% of all-time downloads
xlm-roberta-base-uk
ukr-models/xlm-roberta-base-uk
xlm-roberta-base-uk is a fill-mask model from ukr-models. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This is a smaller version of the XLM-RoBERTa model with only Ukrainian and some English embeddings left.
All-time downloads
7.1K
Public
Parameters
110M
2.4 GB on disk
Likes
13
Public
Repo makeup
Click a slice to open those files.
.bin440 MB · 50%
Parameter types
How the weights are stored.
F32110M · 100%
Try a prompt
Spaces
Model card
From the Hugging Face model README
This is a smaller version of the XLM-RoBERTa model with only Ukrainian and some English embeddings left.
- The original model has 470M parameters, with 384M of them being input and output embeddings.
- After shrinking the
sentencepiecevocabulary from 250K to 31K (top 25K Ukrainian tokens and top English tokens) the number of model parameters reduced to 134M parameters, and model size reduced from 1GB to 400MB.
- Task
- Fill-Mask
- Library
- transformers
- Type
- xlm-roberta
- License
- mit
- Languages
- uk
- Created
- Mar 11, 2022
- Updated
- Aug 31, 2023