Downloads · 30 days
22
3% of all-time downloads
gpt2-poetry-model-crpo
andreipb/gpt2-poetry-model-crpo
gpt2-poetry-model-crpo is a text generation model from andreipb. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is based on the smallest gpt2 model (137 M parameters) fine-tuned on the Gutenberg Poetry Corpus (142 MB of text) for 3 epochs.
All-time downloads
863
Public
Parameters
137M
1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 50%
Parameter types
How the weights are stored.
F32124M · 91%
Try a prompt
Model card
From the Hugging Face model README
gpt2-poetry-model-crpo
This model is based on the smallest gpt2 model (137 M parameters) fine-tuned on the Gutenberg Poetry Corpus (142 MB of text) for 3 epochs.
The model generates lines of poetry, in English, each of them starting with the <start> tag, which can be removed through post-processing.
This model was trained by Teo Ferrari as part of his Bachelor thesis at HEIG-VD, supervised by Andrei Popescu-Belis. The model is described in "GPoeT: a Language Model Trained for Rhyme Generation on Synthetic Data" and is used in the CR-PO system for interactive poem generation, along with several other models for specific topics or emotions.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Languages
- en
- Created
- Sep 7, 2023
- Updated
- Sep 13, 2023