Downloads · 30 days
3
9% of all-time downloads
HachiML/Mistral-7B-v0.3-dpo-lora_sr_mxm1_lr1e-5_5ep
Mistral-7B-v0.3-dpo-lora_sr_mxm1_lr1e-5_5ep is a machine learning model from HachiML. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
9% of all-time downloads
All-time downloads
33
Public
Repo size
609 MB
Likes
0
Public
Click a slice to open those files.
.safetensors609 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of HachiML/Mistral-7B-v0.3-mxm0.5-lora on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.471 | 1.0 | 103 | 0.3446 | -0.9519 | -2.6013 | 0.8304 | 1.6494 | -267.1219 | -380.8956 | 0.8179 | 0.3512 |
| 0.191 | 2.0 | 206 | 0.3087 | -1.6824 | -4.1087 | 0.8512 | 2.4263 | -282.1961 | -388.2008 | 1.3280 | 0.7210 |
| 0.0863 | 3.0 | 309 | 0.2806 | -2.0077 | -4.9634 | 0.9062 | 2.9558 | -290.7433 | -391.4536 | 1.7628 | 1.0070 |
| 0.0485 | 4.0 | 412 | 0.2810 | -2.4278 | -5.6118 | 0.8854 | 3.1840 | -297.2274 | -395.6552 | 2.1611 | 1.2277 |
| 0.0392 | 5.0 | 515 | 0.2840 | -2.3833 | -5.5556 | 0.8854 | 3.1723 | -296.6647 | -395.2098 | 2.1386 | 1.2143 |