Downloads · 30 days
10
6% of all-time downloads
oyo-teams-base-discriminator
Davlan/oyo-teams-base-discriminator
oyo-teams-base-discriminator is a machine learning model from Davlan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
OYO-TEAMS (or Oyo-dialect of Yoruba TEAMS) was created by pre-training a TEAMS model based on ELECTRA architecture on Yoruba language texts for about 100K steps. It was trained using ELECTRA-base architecture with Ten…
All-time downloads
160
Public
Repo size
443 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin443 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- electra
- Access
- Public
- Created
- Aug 22, 2023
- Updated
- Oct 25, 2023
- SHA
- ce746563
Model card
From the Hugging Face model README
oyo-teams-base-discriminator
OYO-TEAMS (or Oyo-dialect of Yoruba TEAMS) was created by pre-training a TEAMS model based on ELECTRA architecture on Yoruba language texts for about 100K steps. It was trained using ELECTRA-base architecture with Tensorflow Model Garden
Pre-training corpus
A mix of WURA, Wikipedia and MT560 Yoruba data
Acknowledgment
We thank @stefan-it for providing the pre-processing and pre-training scripts. Finally, we would like to thank Google Cloud for providing us access to TPU v3-8 through the free cloud credits. Model trained using flax, before converted to pytorch.
BibTeX entry and citation info.
- Library
- transformers
- Type
- electra
- License
- apache-2.0
- Languages
- yo
- Created
- Aug 22, 2023
- Updated
- Oct 25, 2023