Downloads · 30 days
42
3% of all-time downloads
mongolian-gpt2
flax-community/mongolian-gpt2
mongolian-gpt2 is a text generation model from flax-community. Use it when you need the model to write or continue text. It is set up for transformers.
Goal is to create a strong language generation model for Mongolian Since initial code and data is pretty much written by @patrickvonplaten and other huggingface members, it should not be so hard to get the first sense.
All-time downloads
1.5K
Public
Repo size
1.5 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jul 9, 2021
- SHA
- 5c35deb7
Datasets
Model card
From the Hugging Face model README
Mongolian GPT2
Goal is to create a strong language generation model for Mongolian Since initial code and data is pretty much written by @patrickvonplaten and other huggingface members, it should not be so hard to get the first sense.
Model
Randomly initialized GPT2 model
Datasets
We can use OSCAR which is available through datasets
Datasets
A causal language modeling script for Flax is available here 1. It can be used pretty much without any required code changes. If there is time left, I’d love to try some private crawling and integrate it datasets.
Expected Outcome
Understandable Mongolian text generation model
Challenges
Lack of data → OSCAR Mongolian is just 2.2G. Maybe we need to research ways to acquire more data with this.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Languages
- mn
- Created
- Mar 2, 2022
- Updated
- Jul 9, 2021