Downloads · 30 days
16
2% of all-time downloads
GPT2-RLHF-covid
arun-shankar/GPT2-RLHF-covid
GPT2-RLHF-covid is a text generation model from arun-shankar. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Uses PPO and TRL library to align the response based on BERTScore towards the expected response.
All-time downloads
655
Public
Repo size
1 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt2
- Access
- Public
- Created
- Feb 11, 2023
- Updated
- Feb 12, 2023
- SHA
- 9b86c8ab
Try a prompt
Model card
From the Hugging Face model README
GPT2 fine-tuned with COVID-19 question and answer pairs using Reinforcement Learning with Human Feedback (RLHF) and Proximal Policy Optimization (PPO).
Uses PPO and TRL library to align the response based on BERTScore towards the expected response.
You can ask the model any question related to COVID-19 in this format:
question: should i wear a mask at home?\nanswer:
You can also add a CTRL token as a special prefix token in front of your prompt to align it to your preference. For example, you either add a [good] or [bad] token as a prefix.
[good]question: should i wear a mask at school?\nanswer:
Good and bad here refers to the quality of the response. Being more aligned to the expected (ground truth) response is good and not is bad.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- apache-2.0
- Created
- Feb 11, 2023
- Updated
- Feb 12, 2023