Downloads · 30 days
2
6% of all-time downloads
htlou/backup_0202_llamafactory_AA_preference_cosi_new_step10_0_70-llava-mistral
backup_0202_llamafactory_AA_preference_cosi_new_step10_0_70-llava-mistral is a image-text-to-text model from htlou. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
2
6% of all-time downloads
All-time downloads
34
Public
Parameters
7.6B
15.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.1 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of llava-hf/llava-v1.6-mistral-7b-hf on the AA_preference_cosi_new_step10_0_70 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.5778 | 0.5348 | 50 | 0.5711 | 1.2153 | -0.0689 | 0.7560 | 1.2843 | -197.2090 | -246.0286 | -2.3540 | -2.3824 |
| 0.232 | 1.0695 | 100 | 0.4935 | 0.9389 | -1.0786 | 0.8036 | 2.0175 | -207.3059 | -248.7935 | -2.4977 | -2.5262 |
| 0.2427 | 1.6043 | 150 | 0.4994 | 0.6147 | -1.7279 | 0.8185 | 2.3426 | -213.7988 | -252.0355 | -2.1963 | -2.2464 |
| 0.1239 | 2.1390 | 200 | 0.4941 | 0.6670 | -1.8992 | 0.8065 | 2.5662 | -215.5122 | -251.5120 | -2.3605 | -2.3958 |
| 0.1607 | 2.6738 | 250 | 0.5006 | 0.6972 | -2.0217 | 0.8006 | 2.7190 | -216.7369 | -251.2096 | -2.3349 | -2.3732 |