Downloads · 30 days
3
9% of all-time downloads
SleepyGorilla/openhermes-mistral-dpo-gptq
openhermes-mistral-dpo-gptq is a machine learning model from SleepyGorilla. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
9% of all-time downloads
All-time downloads
32
Public
Repo size
68.8 MB
Likes
0
Public
Click a slice to open those files.
.safetensors13.6 MB · 85%
From the Hugging Face model README
This model is a fine-tuned version of TheBloke/OpenHermes-2-Mistral-7B-GPTQ on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.556 | 0.0 | 10 | 0.4270 | 0.0181 | -0.6933 | 1.0 | 0.7114 | -230.5818 | -71.1419 | -2.6557 | -2.3264 |
| 0.3645 | 0.0 | 20 | 0.1583 | 0.1759 | -2.5866 | 1.0 | 2.7625 | -249.5149 | -69.5636 | -2.6400 | -2.3441 |
| 0.2037 | 0.0 | 30 | 0.0681 | 0.0985 | -5.0474 | 1.0 | 5.1459 | -274.1230 | -70.3379 | -2.6245 | -2.3228 |
| 0.0315 | 0.0 | 40 | 0.0431 | -0.9146 | -8.5841 | 1.0 | 7.6695 | -309.4896 | -80.4684 | -2.6094 | -2.3791 |
| 0.0655 | 0.0 | 50 | 0.0323 | -1.0831 | -9.5400 | 1.0 | 8.4569 | -319.0484 | -82.1537 | -2.6023 | -2.2419 |