Downloads · 30 days
104
0% of all-time downloads
electra-base-norwegian-uncased-discriminator
ViktorAlm/electra-base-norwegian-uncased-discriminator
electra-base-norwegian-uncased-discriminator is a machine learning model from ViktorAlm. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
All-time downloads
109K
Public
Repo size
1.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.h5437 MB · 50%
At a glance
- Library
- transformers
- Model type
- electra
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Dec 11, 2020
- SHA
- 51891672
Model card
From the Hugging Face model README
Norwegian Electra
Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8)
Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet.
Model
Electra: Pre-training Text Encoders as Discriminators Rather Than Generators
Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning
Acknowledgments
TensorFlow Research Cloud
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
OSCAR corpus
OPUS
- Library
- transformers
- Type
- electra
- Languages
- no
- Created
- Mar 2, 2022
- Updated
- Dec 11, 2020