Downloads · 30 days
10
24% of all-time downloads
Weni/WeniGPT-Agents-Mistral-1.0.0-SFT-1.0.22-DPO
WeniGPT-Agents-Mistral-1.0.0-SFT-1.0.22-DPO is a machine learning model from Weni. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
10
24% of all-time downloads
All-time downloads
42
Public
Repo size
2 GB
Likes
0
Public
Click a slice to open those files.
.pt1.3 GB · 57%
From the Hugging Face model README
This model is a fine-tuned version of Weni/WeniGPT-Agents-Mistral-1.0.0-SFT-merged on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.5055 | 0.9677 | 30 | 0.4410 | 0.6284 | -0.0380 | 1.0 | 0.6664 | -231.5955 | -130.0576 | -1.8176 | -1.8109 |
| 0.2624 | 1.9355 | 60 | 0.2709 | 1.2835 | -0.2282 | 0.8571 | 1.5117 | -233.4975 | -123.5067 | -1.8171 | -1.8112 |
| 0.2034 | 2.9032 | 90 | 0.1831 | 1.6577 | -0.4392 | 0.8571 | 2.0969 | -235.6068 | -119.7638 | -1.8201 | -1.8148 |
| 0.1597 | 3.8710 | 120 | 0.1410 | 1.8326 | -0.6890 | 1.0 | 2.5216 | -238.1049 | -118.0154 | -1.8244 | -1.8193 |
| 0.1056 | 4.8387 | 150 | 0.1193 | 1.8704 | -0.8951 | 1.0 | 2.7655 | -240.1666 | -117.6375 | -1.8182 | -1.8134 |
| 0.1218 | 5.8065 | 180 | 0.1118 | 1.8747 | -0.9846 | 1.0 | 2.8593 | -241.0612 | -117.5944 | -1.8155 | -1.8108 |