Downloads · 30 days
44
4% of all-time downloads
ayameRushia/gpt2-medium-fine-tuning-indonesia-poem
gpt2-medium-fine-tuning-indonesia-poem is a text generation model from ayameRushia. Use it when you need the model to write or continue text. It is set up for transformers.
This is the Indonesian gpt2-medium model fine-tuned to Indonesian poems. The dataset can be found in here All training was done on Google Colab Jupyter Notebook (soon).
Downloads · 30 days
44
4% of all-time downloads
All-time downloads
1.1K
Public
Repo size
2.9 GB
Likes
0
Public
Click a slice to open those files.
.bin1.4 GB · 100%
From the Hugging Face model README
This is the Indonesian gpt2-medium model fine-tuned to Indonesian poems. The dataset can be found in here All training was done on Google Colab Jupyter Notebook (soon).
The dataset is splitted into two subset with details belows:
| split | count (examples) | percentage |
|---|---|---|
| train | 7,358 | 80% |
| validation | 1,890 | 20% |
The model evaluation results after 10 epochs are as follows:
| dataset | train/loss | eval/loss | eval perplexity |
|---|---|---|---|
| id puisi | 3.104 | 3.384 | 29.4884 |
The logs can be found in wandb page here