Downloads · 30 days
18
1% of all-time downloads
t5-base-norwegian
patrickvonplaten/t5-base-norwegian
t5-base-norwegian is a machine learning model from patrickvonplaten. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This model trains T5-V11-base on the Norwegian dataset of Oscar. Note that the original configuration is slightly change (dropout is set to 0).
All-time downloads
1.2K
Public
Repo size
27.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.msgpack990 MB · 98%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Aug 10, 2021
- SHA
- e072ba62
Model card
From the Hugging Face model README
This model trains T5-V1_1-base on the Norwegian dataset of Oscar. Note that the original configuration is slightly change (dropout is set to 0).
The official run_t5_mlm_flax.py is copied into the repository and is run using the hyperparameters as defined in run_t5.sh.
Training loss can be seen directly on the model card. The full training runs in finished in ca. 4 hours and 30 minutes.
- Library
- transformers
- Type
- t5
- Created
- Mar 2, 2022
- Updated
- Aug 10, 2021