Downloads · 30 days
17
40% of all-time downloads
htlou/backup_0202_llamafactory_AA_preference_cocour_new_step10_0_90-llava-mistral
backup_0202_llamafactory_AA_preference_cocour_new_step10_0_90-llava-mistral is a image-text-to-text model from htlou. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
17
40% of all-time downloads
All-time downloads
43
Public
Parameters
7.6B
15.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.1 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of llava-hf/llava-v1.6-mistral-7b-hf on the AA_preference_cocour_new_step10_0_90 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6087 | 0.4158 | 50 | 0.5778 | 0.7419 | -0.5074 | 0.7870 | 1.2493 | -207.0612 | -241.1710 | -2.5285 | -2.5456 |
| 0.5039 | 0.8316 | 100 | 0.5226 | 0.2943 | -1.5654 | 0.8056 | 1.8596 | -217.6406 | -245.6472 | -2.5932 | -2.6105 |
| 0.2346 | 1.2474 | 150 | 0.4851 | 0.5179 | -1.8870 | 0.8356 | 2.4048 | -220.8566 | -243.4111 | -2.5511 | -2.5729 |
| 0.26 | 1.6632 | 200 | 0.4692 | 0.8149 | -1.7120 | 0.8264 | 2.5269 | -219.1066 | -240.4409 | -2.6651 | -2.6766 |
| 0.1628 | 2.0790 | 250 | 0.4654 | 0.2522 | -2.4566 | 0.8264 | 2.7088 | -226.5530 | -246.0683 | -2.6802 | -2.6929 |
| 0.1808 | 2.4948 | 300 | 0.4721 | 0.8229 | -2.0114 | 0.8241 | 2.8342 | -222.1007 | -240.3612 | -2.6392 | -2.6528 |
| 0.1514 | 2.9106 | 350 | 0.4736 | 0.5409 | -2.3033 | 0.8218 | 2.8442 | -225.0204 | -243.1809 | -2.6346 | -2.6500 |