Downloads · 30 days
9
14% of all-time downloads
vistagi/gpt2-large-tldr-sum-rlhf
gpt2-large-tldr-sum-rlhf is a text generation model from vistagi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Based on SFT model ellipseai/gpt2-large-tldr-sum and perform RLHF training for better human alignment. The training curve on validation reward is
Downloads · 30 days
9
14% of all-time downloads
All-time downloads
66
Public
Repo size
6.7 GB
Likes
0
Public
Click a slice to open those files.
.bin1.8 GB · 100%
From the Hugging Face model README
Based on SFT model ellipseai/gpt2-large-tldr-sum and perform RLHF training for better human alignment. The training curve on validation reward is

We perform evaluation for SFT model and RL model on 386 test set on the summarization quality with Claude-v2 to judge winner. We observe that RL model is significantly better than SFT model. This demonstrate that RL training is work very well.
| model | win | loss | tie | win rate | loss rate | win rate adjusted |
|---|---|---|---|---|---|---|
| ellipseai/gpt2-large-tldr-sum | 24 | 151 | 211 | 0.0622 | 0.3911 | 33.55% |
| ellipseai/gpt2-large-tldr-sum-rlhf | 151 | 24 | 211 | 0.3911 | 0.0622 | 66.45% |