Downloads · 30 days
12
0% of all-time downloads
patrickvonplaten/norwegian-roberta-base
norwegian-roberta-base is a fill-mask model from patrickvonplaten. Use it when you need the model to fill a missing word. It is set up for transformers.
This repo trains roberta-base from scratch on the Norwegian training subset of Oscar containing roughly 4.7 GB of data according to this example.
Downloads · 30 days
12
0% of all-time downloads
All-time downloads
5.3K
Public
Repo size
2.5 GB
Likes
0
Public
Click a slice to open those files.
.bin499 MB · 50%
From the Hugging Face model README
This repo trains roberta-base from scratch on the Norwegian training subset of Oscar containing roughly 4.7 GB of data according to this example.
Training is done on a TPUv3-8 in Flax. More statistics on the training run can be found under tf.hub.