Downloads · 30 days
28
2% of all-time downloads
BRATA_RoBERTaBali
AryaSuprana/BRATA_RoBERTaBali
BRATA_RoBERTaBali is a fill-mask model from AryaSuprana. Use it when you need the model to fill a missing word. It is set up for transformers.
BRATA (Basa Bali Used for Pretraining RoBERTa) is a pretrained language model trained using Basa Bali or Balinese Language with RoBERTa-base-uncased configuration. The datasets used for this pretraining were collected…
All-time downloads
1.4K
Public
Repo size
2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1 GB · 60%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Jun 11, 2022
- Updated
- Jun 11, 2022
- SHA
- 7b7518cb
Try a prompt
Model card
From the Hugging Face model README
BRATA (Basa Bali Used for Pretraining RoBERTa) is a pretrained language model trained using Basa Bali or Balinese Language with RoBERTa-base-uncased configuration. The datasets used for this pretraining were collected by extracting WikiBali or Wikipedia Basa Bali and some sources from Suara Saking Bali website. The pretrained language model trained using Google Colab Pro with Tesla P100-PCIE-16GB GPU. Pretraining process used 200 epoch and 2 batch size. The smallest training loss can be seen in Training metrics or Metrics tab.
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- Languages
- ban
- Created
- Jun 11, 2022
- Updated
- Jun 11, 2022