Downloads · 30 days
0
kinya-gpt-2
DigitalUmuganda/kinya-gpt-2
kinya-gpt-2 is a text generation model from DigitalUmuganda. Use it when you need the model to write or continue text.
Kinyarwanda GPT-2 model based on Andrej Karpathy's nanoGPT. It was trained on a mixture of news data and diverse computer-generated datasets in Kinyarwanda.
Access
Public
Updated Apr 29, 2023
Repo size
360 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt360 MB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- Apr 28, 2023
- Updated
- Apr 29, 2023
- SHA
- 9e7f706f
Model card
From the Hugging Face model README
Kinyarwanda GPT-2 model based on Andrej Karpathy's nanoGPT. It was trained on a mixture of news data and diverse computer-generated datasets in Kinyarwanda.
Model configuration
- number of layers = 6
- number of heads = 6
- embeddings = 384
- block size = 256
Model dependencies
pip install transformers datasets tiktoken wandb tqdm
Usage
To use this model to generate text, download all the files in the repo and put them in the same directory, then run the following command:
python sample.py --out_dir=.
- Task
- Text Generation
- Languages
- rw
- Created
- Apr 28, 2023
- Updated
- Apr 29, 2023