Downloads · 30 days
3
18% of all-time downloads
Kimory-X/zephyr-7b-mypo3-qlora-beta3.0-lr5e6
zephyr-7b-mypo3-qlora-beta3.0-lr5e6 is a machine learning model from Kimory-X. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
18% of all-time downloads
All-time downloads
17
Public
Repo size
3.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors671 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of alignment-handbook/zephyr-7b-sft-qlora on the HuggingFaceH4/ultrafeedback_binarized dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1.3544 | 0.2093 | 100 | 1.3633 | -0.0070 | -0.2477 | 0.7148 | 0.2406 | -1.1280 | -0.8934 | -2.0575 | -2.1428 |
| 1.3536 | 0.4186 | 200 | 1.3536 | 0.0517 | -0.2361 | 0.7285 | 0.2878 | -1.1241 | -0.8738 | -2.0771 | -2.1592 |
| 1.3432 | 0.6279 | 300 | 1.3529 | -0.0251 | -0.3537 | 0.7383 | 0.3286 | -1.1633 | -0.8994 | -2.0160 | -2.1026 |
| 1.3502 | 0.8373 | 400 | 1.3491 | 0.0166 | -0.3186 | 0.7441 | 0.3352 | -1.1516 | -0.8855 | -1.9918 | -2.0802 |