Downloads · 30 days
6
21% of all-time downloads
Kimory-X/zephyr-7b-mypo3_sim-qlora-lr5e6-beta0.15
zephyr-7b-mypo3_sim-qlora-lr5e6-beta0.15 is a machine learning model from Kimory-X. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
6
21% of all-time downloads
All-time downloads
28
Public
Repo size
12.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors671 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of mistralai/Mistral-7B-v0.1 on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Logits/chosen | Logits/rejected | Logps/chosen | Logps/rejected | Validation Loss | Rewards/accuracies | Rewards/chosen | Rewards/margins | Rewards/rejected |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1.3828 | 0.0654 | 100 | -2.2733 | -2.1890 | -0.9795 | -1.2337 | 1.3826 | 0.6500 | -0.0081 | 0.0183 | -0.0264 |
| 1.3788 | 0.1308 | 200 | -2.2411 | -2.1662 | -1.1617 | -1.6384 | 1.3779 | 0.6875 | -0.0354 | 0.0516 | -0.0871 |
| 1.3661 | 0.1963 | 300 | -1.9769 | -1.8987 | -1.5192 | -2.6348 | 1.3710 | 0.6925 | -0.0891 | 0.1475 | -0.2365 |
| 1.3681 | 0.2617 | 400 | -1.9280 | -1.8432 | -1.5380 | -2.9063 | 1.3679 | 0.6925 | -0.0919 | 0.1854 | -0.2773 |
| 1.3663 | 0.3271 | 500 | -1.7767 | -1.6841 | -1.3549 | -2.6621 | 1.3664 | 0.7150 | -0.0644 | 0.1762 | -0.2406 |
| 1.3548 | 0.3925 | 600 | -1.7095 | -1.6093 | -1.5067 | -3.1073 | 1.3652 | 0.6925 | -0.0872 | 0.2202 | -0.3074 |
| 1.3679 | 0.4580 | 700 | -1.8011 | -1.7034 | -1.3761 | -2.9341 | 1.3630 | 0.6900 | -0.0676 | 0.2138 | -0.2814 |
| 1.361 | 0.5234 | 800 | -1.7803 | -1.6813 | -1.4460 | -3.1243 | 1.3629 | 0.6975 | -0.0781 | 0.2319 | -0.3100 |
| 1.3487 | 0.5888 | 900 | -1.8365 | -1.7354 | -1.3839 | -3.1708 | 1.3584 | 0.6875 | -0.0688 | 0.2482 | -0.3169 |
| 1.3615 | 0.6542 | 1000 | -1.8152 | -1.7073 | -1.4071 | -3.4528 | 1.3591 | 0.6950 | -0.0722 | 0.2870 | -0.3592 |
| 1.354 | 0.7197 | 1100 | -1.7806 | -1.6713 | -1.4868 | -3.5927 | 1.3602 | 0.7050 | -0.0842 | 0.2960 | -0.3802 |
| 1.3569 | 0.7851 | 1200 | -1.7902 | -1.6828 | -1.4181 | -3.3873 | 1.3583 | 0.7050 | -0.0739 | 0.2755 | -0.3494 |
| 1.3516 | 0.8505 | 1300 | -1.7830 | -1.6740 | -1.4445 | -3.4637 | 1.3587 | 0.7025 | -0.0778 | 0.2830 | -0.3609 |
| 1.3547 | 0.9159 | 1400 | -1.7848 | -1.6759 | -1.4412 | -3.4624 | 1.3585 | 0.7050 | -0.0773 | 0.2833 | -0.3607 |
| 1.3531 | 0.9814 | 1500 | -1.7863 | -1.6776 | -1.4414 | -3.4632 | 1.3585 | 0.7050 | -0.0774 | 0.2834 | -0.3608 |