Downloads · 30 days
2
8% of all-time downloads
mnoukhov/pythia410m-dpo-tldr-lr1e-5
pythia410m-dpo-tldr-lr1e-5 is a machine learning model from mnoukhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
2
8% of all-time downloads
All-time downloads
24
Public
Repo size
101 MB
Likes
0
Public
Click a slice to open those files.
.json2.1 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of mnoukhov/pythia410m-sft-tldr on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logps/ref Rejected | Logps/ref Chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6295 | 0.2 | 291 | 0.5864 | -0.5101 | -0.8319 | 0.7039 | 0.3218 | -80.4685 | -80.4685 | -63.5119 | -70.2656 |
| 0.5926 | 0.4 | 582 | 0.5600 | -0.9009 | -1.3738 | 0.7120 | 0.4728 | -88.2839 | -88.2839 | -63.5119 | -70.2656 |
| 0.5761 | 0.6 | 873 | 0.5585 | -0.9509 | -1.4326 | 0.7110 | 0.4817 | -89.2846 | -89.2846 | -63.5119 | -70.2656 |
| 0.5678 | 0.8 | 1164 | 0.5595 | -0.9059 | -1.3735 | 0.7113 | 0.4677 | -88.3830 | -88.3830 | -63.5119 | -70.2656 |