Downloads · 30 days
0
anugoel890/openhermes-mistral-dpo-gptq
openhermes-mistral-dpo-gptq is a machine learning model from anugoel890. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
0
Access
Public
Updated Dec 17, 2023
Repo size
27.8 MB
Likes
0
Public
Click a slice to open those files.
.safetensors13.6 MB · 85%
From the Hugging Face model README
This model is a fine-tuned version of TheBloke/OpenHermes-2-Mistral-7B-GPTQ on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6989 | 0.01 | 10 | 0.6566 | -0.0830 | -0.1482 | 0.75 | 0.0652 | -302.8232 | -273.9107 | -1.8738 | -1.7954 |
| 0.6578 | 0.01 | 20 | 0.5787 | 0.0468 | -0.2201 | 0.8125 | 0.2669 | -303.5421 | -272.6130 | -1.8707 | -1.7965 |
| 0.715 | 0.01 | 30 | 0.5021 | 0.2256 | -0.3134 | 0.8125 | 0.5391 | -304.4756 | -270.8246 | -1.8729 | -1.8014 |
| 0.6847 | 0.02 | 40 | 0.4673 | 0.2097 | -0.6320 | 0.875 | 0.8417 | -307.6610 | -270.9843 | -1.8682 | -1.7996 |
| 0.7869 | 0.03 | 50 | 0.4545 | -0.0587 | -1.0907 | 0.875 | 1.0320 | -312.2487 | -273.6681 | -1.8614 | -1.7936 |