Downloads · 30 days
32
1% of all-time downloads
gpt2-imdb-pos
lvwerra/gpt2-imdb-pos
gpt2-imdb-pos is a machine learning model from lvwerra. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
A small GPT2 (lvwerra/gpt2-imdb) language model fine-tuned to produce positive movie reviews based the IMDB dataset. The model is trained with rewards from a BERT sentiment classifier (lvwerra/gpt2-imdb) via PPO.
All-time downloads
2.6K
Public
Repo size
1.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin548 MB · 100%
At a glance
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- May 23, 2021
- SHA
- 649cebca
Model card
From the Hugging Face model README
GPT2-IMDB-pos
What is it?
A small GPT2 (lvwerra/gpt2-imdb) language model fine-tuned to produce positive movie reviews based the IMDB dataset. The model is trained with rewards from a BERT sentiment classifier (lvwerra/gpt2-imdb) via PPO.
Training setting
The model was trained for 100 optimisation steps with a batch size of 256 which corresponds to 25600 training samples. The full experiment setup can be found in the Jupyter notebook in the trl repo.
Examples
A few examples of the model response to a query before and after optimisation:
| query | response (before) | response (after) | rewards (before) | rewards (after) |
|---|---|---|---|---|
| I'd never seen a | heavier, woodier example of Victorian archite... | film of this caliber, and I think it's wonder... | 3.297736 | 4.158653 |
| I love John's work | but I actually have to write language as in w... | and I hereby recommend this film. I am really... | -1.904006 | 4.159198 |
| I's a big struggle | to see anyone who acts in that way. by Jim Th... | , but overall I'm happy with the changes even ... | -1.595925 | 2.651260 |
- Library
- transformers
- Type
- gpt2
- Created
- Mar 2, 2022
- Updated
- May 23, 2021