Downloads · 30 days
28
6% of all-time downloads
amirali1985/gpt-neo-125m_hh_reward
gpt-neo-125m_hh_reward is a text generation model from amirali1985. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
28
6% of all-time downloads
All-time downloads
475
Public
Parameters
125M
45.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors501 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of EleutherAI/gpt-neo-125m on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.8022 | 0.2 | 2000 | 0.7737 | -4.8718 | -5.0523 | 0.5724 | 0.1805 | -175.2956 | -153.5872 | -11.7730 | -11.6673 |
| 0.7336 | 0.4 | 4000 | 0.7503 | -4.2523 | -4.3731 | 0.5625 | 0.1208 | -168.5040 | -147.3926 | -11.6528 | -11.5062 |