Downloads · 30 days
11
14% of all-time downloads
andreipb/roberta-poetry-anger-crpo
roberta-poetry-anger-crpo is a fill-mask model from andreipb. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This model is based on the RoBERTa base model (125 M parameters) fine-tuned for 20 epochs on a poetry dataset of 33 MB. This dataset was extracted from the Gutenberg Poetry Corpus using an automatic classifier for anger.
Downloads · 30 days
11
14% of all-time downloads
All-time downloads
79
Public
Parameters
125M
998 MB on disk
Likes
0
Public
Click a slice to open those files.
.bin499 MB · 50%
How the weights are stored.
F32125M · 100%
From the Hugging Face model README
This model is based on the RoBERTa base model (125 M parameters) fine-tuned for 20 epochs on a poetry dataset of 33 MB. This dataset was extracted from the Gutenberg Poetry Corpus using an automatic classifier for anger.
The model replaces a masked word, indicated by the <mask> tag, with a word associated with anger, while preserving fluency.
Caution: the emotion (here, anger) only biases the choice of words with respect to the base model, so do not expect to find
only words strongly associated to this emotion.
This model was trained by Teo Ferrari as part of his Bachelor thesis at HEIG-VD, supervised by Andrei Popescu-Belis. The model is described in "GPoeT: a Language Model Trained for Rhyme Generation on Synthetic Data" and is used in the CR-PO system for interactive poem generation, along with several other models for specific topics or emotions.