Downloads · 30 days
31
6% of all-time downloads
gpt2-tigrinya-small
luel/gpt2-tigrinya-small
gpt2-tigrinya-small is a text generation model from luel. Use it when you need the model to write or continue text. It is set up for transformers.
This repository contains a GPT-2 model trained from scratch on Tigrinya text data. The model was trained using the Hugging Face Transformers library.
All-time downloads
489
Public
Parameters
16.8M
135 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin67.4 MB · 49%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Oct 29, 2024
- Updated
- Nov 2, 2024
- SHA
- 895ff254
Model card
From the Hugging Face model README
GPT-2 for Tigrinya Language
This repository contains a GPT-2 model trained from scratch on Tigrinya text data. The model was trained using the Hugging Face Transformers library.
Model Details
- Model Type: GPT-2
- Language: Tigrinya
- Vocabulary Size: 16000
- Maximum Length: 128
Training Details
- Number of Epochs: 12
- Batch Size: 1 (with gradient accumulation steps of 4)
- Learning Rate: 5e-4
Dataset Statistics
- Total number of words: 16061839
- Total number of unique words: 458901
Usage
from transformers import pipeline
# Load the model
generator = pipeline('text-generation', model='luel/gpt2-tigrinya-small')
# Generate text
text = generator("ትግራይ", max_length=60)
print(text)
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Languages
- ti
- Created
- Oct 29, 2024
- Updated
- Nov 2, 2024