Downloads · 30 days
7
18% of all-time downloads
sfulay/zephyr-7b-dpo-full-magpi-low-bleu-3-epochs
zephyr-7b-dpo-full-magpi-low-bleu-3-epochs is a machine learning model from sfulay. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
18% of all-time downloads
All-time downloads
39
Public
Parameters
7.2B
57.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of alignment-handbook/zephyr-7b-sft-full on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.0066 | 0.4739 | 50 | 0.0028 | -1.0908 | -33.9616 | 0.9980 | 32.8709 | -4036.9529 | -476.0595 | -1.2144 | -1.9103 |
| 0.0177 | 0.9479 | 100 | 0.0006 | -1.6117 | -43.9541 | 1.0 | 42.3424 | -5036.1978 | -528.1522 | 1.4562 | -2.1299 |
| 0.0006 | 1.4218 | 150 | 0.0004 | -1.7244 | -46.1666 | 1.0 | 44.4422 | -5257.4517 | -539.4232 | 1.6969 | -1.9837 |
| 0.0002 | 1.8957 | 200 | 0.0005 | -1.7575 | -44.7450 | 1.0 | 42.9875 | -5115.2886 | -542.7341 | 2.1634 | -2.0033 |
| 0.0001 | 2.3697 | 250 | 0.0004 | -1.8985 | -46.5225 | 1.0 | 44.6240 | -5293.0405 | -556.8339 | 2.7114 | -1.2429 |
| 0.0001 | 2.8436 | 300 | 0.0004 | -1.8844 | -46.8077 | 1.0 | 44.9232 | -5321.5576 | -555.4259 | 2.7529 | -1.2323 |