Downloads · 30 days
27
2% of all-time downloads
takalane_zul_roberta
jannesg/takalane_zul_roberta
takalane_zul_roberta is a fill-mask model from jannesg. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
<img src="https://pbs.twimg.com/media/EVjR6BsWoAAFaq5.jpg" width="600"/
All-time downloads
1.3K
Public
Repo size
1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin336 MB · 50%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Sep 22, 2021
- SHA
- bb451723
Model card
From the Hugging Face model README
Takalani Sesame - Zulu 🇿🇦
<img src="https://pbs.twimg.com/media/EVjR6BsWoAAFaq5.jpg" width="600"/>Model description
Takalani Sesame (named after the South African version of Sesame Street) is a project that aims to promote the use of South African languages in NLP, and in particular look at techniques for low-resource languages to equalise performance with larger languages around the world.
Intended uses & limitations
How to use
from transformers import AutoTokenizer, AutoModelWithLMHead
tokenizer = AutoTokenizer.from_pretrained("jannesg/takalane_zul_roberta")
model = AutoModelWithLMHead.from_pretrained("jannesg/takalane_zul_roberta")
Limitations and bias
Updates will be added continously to improve performance.
Training data
Data collected from https://wortschatz.uni-leipzig.de/en <br/> Sentences: 410000
Training procedure
No preprocessing. Standard Huggingface hyperparameters.
Author
Jannes Germishuys website
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- License
- mit
- Languages
- zul
- Created
- Mar 2, 2022
- Updated
- Sep 22, 2021