Downloads · 30 days
124
15% of all-time downloads
sinhala-gpt-lyrics
Ransaka/sinhala-gpt-lyrics
sinhala-gpt-lyrics is a text generation model from Ransaka. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This particular model has undergone fine-tuning based on the gpt2 architecture, utilizing a dataset of around 500k Sinhala lyrics from various sources. This Model is not sophisticated at all. Created while following o…
All-time downloads
824
Public
Repo size
49.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Mar 24, 2023
- Updated
- Nov 29, 2023
- SHA
- a6dc2e25
Try a prompt
Model card
From the Hugging Face model README
sinhala-gpt-lyrics
This particular model has undergone fine-tuning based on the gpt2 architecture, utilizing a dataset of around 500k Sinhala lyrics from various sources. This Model is not sophisticated at all. Created while following one of fine-tuning docs.
Usage Details
from transformers import AutoTokenizer, AutoModelForCausalLM,pipeline
tokenizer = AutoTokenizer.from_pretrained("Ransaka/sinhala-gpt-lyrics")
model = AutoModelForCausalLM.from_pretrained("Ransaka/sinhala-gpt-lyrics")
generator = pipeline('text-generation',model=model, tokenizer=tokenizer)
generator("දුර") #දුර ඈත පාසැල් වියේ.
or using git
git lfs install
git clone https://huggingface.co/Ransaka/sinhala-gpt-lyrics
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3
Training results
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 2.3015 | 1.0 | 15323 | 2.3498 |
| 1.8582 | 2.0 | 30646 | 1.9921 |
| 1.5491 | 3.0 | 45969 | 1.9376 |
Framework versions
- Transformers 4.26.1
- Pytorch 1.13.0
- Datasets 2.1.0
- Tokenizers 0.13.2
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Created
- Mar 24, 2023
- Updated
- Nov 29, 2023