Downloads · 30 days
4
1% of all-time downloads
roberta-poetry-art-crpo
andreipb/roberta-poetry-art-crpo
roberta-poetry-art-crpo is a fill-mask model from andreipb. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This model is based on the RoBERTa base model (125M parameters) fine-tuned for 20 epochs on a poetry dataset of 52 MB. This dataset was extracted from the Gutenberg Poetry Corpus using an automatic classifier for poem…
All-time downloads
357
Public
Parameters
125M
998 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin499 MB · 50%
Parameter types
How the weights are stored.
F32125M · 100%
Try a prompt
Model card
From the Hugging Face model README
roberta-poetry-art-crpo
This model is based on the RoBERTa base model (125M parameters) fine-tuned for 20 epochs on a poetry dataset of 52 MB. This dataset was extracted from the Gutenberg Poetry Corpus using an automatic classifier for poems in relation with the topic of art.
The model replaces a masked word, indicated by the <mask> tag, with a word associated with art, while preserving fluency.
Caution: the topic (here, art) only biases the choice of words with respect to the base model, but do not expect to find
only words strongly associated to this topic.
This model was trained by Teo Ferrari as part of his Bachelor thesis at HEIG-VD, supervised by Andrei Popescu-Belis. The model is described in "GPoeT: a Language Model Trained for Rhyme Generation on Synthetic Data" and is used in the CR-PO system for interactive poem generation, along with several other models for specific topics or emotions.
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- License
- mit
- Languages
- en
- Created
- Sep 13, 2023
- Updated
- Sep 13, 2023