Downloads · 30 days
3
18% of all-time downloads
Kimory-X/zephyr-7b-mypo3-qlora-beta2.5-lr5e6
zephyr-7b-mypo3-qlora-beta2.5-lr5e6 is a machine learning model from Kimory-X. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
18% of all-time downloads
All-time downloads
17
Public
Repo size
3.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors671 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of mistralai/Mistral-7B-v0.1 on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1.3555 | 0.2093 | 100 | 1.3642 | -0.0272 | -0.2716 | 0.7266 | 0.2444 | -1.1541 | -0.9020 | -2.0549 | -2.1403 |
| 1.355 | 0.4186 | 200 | 1.3551 | 0.0565 | -0.2069 | 0.7227 | 0.2634 | -1.1282 | -0.8685 | -2.0756 | -2.1581 |
| 1.344 | 0.6279 | 300 | 1.3538 | -0.0407 | -0.3700 | 0.7363 | 0.3293 | -1.1934 | -0.9073 | -2.0130 | -2.0998 |
| 1.3506 | 0.8373 | 400 | 1.3495 | 0.0059 | -0.3228 | 0.7422 | 0.3287 | -1.1745 | -0.8887 | -1.9998 | -2.0873 |