Downloads · 30 days
64
0% of all-time downloads
deberta-v3-large-tasksource-rlhf-reward-model
sileod/deberta-v3-large-tasksource-rlhf-reward-model
deberta-v3-large-tasksource-rlhf-reward-model is a text classification model from sileod. Use it when you need a label for a piece of text. It is set up for transformers.
All-time downloads
59K
Public
Repo size
5.2 GB
Likes
11
Public
Repo makeup
Click a slice to open those files.
.bin1.7 GB · 99%
At a glance
- Task
- Text Classification
- Library
- transformers
- Model type
- deberta-v2
- Access
- Public
- Created
- Mar 28, 2023
- Updated
- Mar 28, 2023
- SHA
- 2787455c
Try a prompt
Datasets
Model card
From the Hugging Face model README
Reward model based deberta-v3-large-tasksource-nli fine-tuned on Anthropic/hh-rlhf
For 1 epoch with 1e-5 learning rate.
The data are described in the paper: Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback.
Validation accuracy is currently the best publicly available reported: 75.16% (vs 69.25% for OpenAssistant/reward-model-deberta-v3-large-v2).
- Task
- Text Classification
- Library
- transformers
- Type
- deberta-v2
- Languages
- en
- Created
- Mar 28, 2023
- Updated
- Mar 28, 2023