Downloads · 30 days
18
10% of all-time downloads
gpt2-imdb-movie-reviews-negative
Samzy17/gpt2-imdb-movie-reviews-negative
gpt2-imdb-movie-reviews-negative is a text generation model from Samzy17. Use it when you need the model to write or continue text. The card lists the license as mit.
Finetune base model GPT2-IMDB using a using this BERT sentiment classifier as a reward function.
All-time downloads
183
Public
Parameters
124M
498 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors498 MB · 99%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Feb 4, 2025
- Updated
- Feb 6, 2025
- SHA
- d64b82ef
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Purpose of this finetuning
<!-- Provide a quick summary of what the model is/does. -->Finetune base model GPT2-IMDB using a using this BERT sentiment classifier as a reward function.
- The goal is to train the GPT2 model to extrapolate on a movie review and generate negative sentiment.
- There is a separate training done to generate positive movie reviews. The eventual goal would be to interpolate the weight spaces of the 'positively fintuned' and 'negatively finetuned' models as per the rewarded-soups paper and test if it results in (qualitatively) neutral reviews.
Model Params
Here are the traning parameters
- base_model ='lvwerra/gpt2-imdb'
- dataset = stanfordnlp/imdb
- batch_size = 16
- learning_rate = 1.41e-5
- output_max_length = 16
- output_min_length = 4
Not sure how long it took, but less than a couple hours on a single A6000 GPU
Results
- Task
- Text Generation
- Type
- gpt2
- License
- mit
- Created
- Feb 4, 2025
- Updated
- Feb 6, 2025