Downloads · 30 days
3
3% of all-time downloads
sfulay/zephyr-7b-dpo-full-magpi-high-bleu-3-epochs
zephyr-7b-dpo-full-magpi-high-bleu-3-epochs is a machine learning model from sfulay. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
3% of all-time downloads
All-time downloads
97
Public
Parameters
7.2B
72.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of alignment-handbook/zephyr-7b-sft-full on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.0025 | 0.4739 | 50 | 0.0067 | -1.4454 | -37.1575 | 0.9940 | 35.7120 | -4356.5356 | -511.5262 | -3.0434 | -3.2142 |
| 0.0036 | 0.9479 | 100 | 0.0053 | -2.0303 | -41.2450 | 0.9940 | 39.2146 | -4765.2842 | -570.0164 | -3.2429 | -3.4104 |
| 0.0001 | 1.4218 | 150 | 0.0070 | -1.9459 | -45.2030 | 0.9940 | 43.2570 | -5161.0879 | -561.5757 | -3.5068 | -3.5867 |
| 0.0 | 1.8957 | 200 | 0.0047 | -1.4539 | -44.2686 | 0.9960 | 42.8147 | -5067.6450 | -512.3704 | -3.4229 | -3.5020 |
| 0.0 | 2.3697 | 250 | 0.0050 | -1.4525 | -44.7537 | 0.9960 | 43.3012 | -5116.1577 | -512.2269 | -3.4445 | -3.5510 |
| 0.0 | 2.8436 | 300 | 0.0050 | -1.4582 | -44.8746 | 0.9960 | 43.4164 | -5128.2480 | -512.8050 | -3.4441 | -3.5504 |