Downloads · 30 days
550
2% of all-time downloads
IndoT5-base
Wikidepia/IndoT5-base
IndoT5-base is a machine learning model from Wikidepia. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
T5 (Text-to-Text Transfer Transformer) model pretrained on Indonesian mC4 with extra filtering. This model is pre-trained only and needs to be fine-tuned to be used for specific tasks.
All-time downloads
34.6K
Public
Repo size
5.5 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin990 MB · 100%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jul 4, 2021
- SHA
- da8e5576
Datasets
Model card
From the Hugging Face model README
Indonesian T5 Base
T5 (Text-to-Text Transfer Transformer) model pretrained on Indonesian mC4 with extra filtering. This model is pre-trained only and needs to be fine-tuned to be used for specific tasks.
Pretraining Details
Trained for 1M steps following google/t5-v1_1-base.
Model Performance
TBD
Limitations and bias
This model also has the problem of biased (unethical, harmful, biased) output results due to the bias of the content of the training data, which is associated with the language model using a large-scale corpus. There is potential. Assuming that this problem may occur, please be careful to use it only for applications that do not cause damage.
Acknowledgement
Thanks to Tensorflow Research Cloud for providing TPU v3-8s.
- Library
- transformers
- Type
- t5
- Languages
- id
- Created
- Mar 2, 2022
- Updated
- Jul 4, 2021