Downloads · 30 days
2
5% of all-time downloads
htlou/backup_0202_llamafactory_RLAIF-V-L0-q0_25_preference-llava-mistral
backup_0202_llamafactory_RLAIF-V-L0-q0_25_preference-llava-mistral is a image-text-to-text model from htlou. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
2
5% of all-time downloads
All-time downloads
40
Public
Parameters
7.6B
15.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.1 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of llava-hf/llava-v1.6-mistral-7b-hf on the RLAIF-V-L0-q0_25_preference dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.5342 | 0.6944 | 50 | 0.5209 | -0.2071 | -0.9491 | 0.7148 | 0.7420 | -170.1774 | -159.8791 | -2.4678 | -2.4995 |
| 0.217 | 1.3889 | 100 | 0.5167 | -1.1670 | -2.3865 | 0.7070 | 1.2195 | -184.5513 | -169.4779 | -2.4044 | -2.4350 |
| 0.105 | 2.0833 | 150 | 0.5275 | -2.3365 | -3.9689 | 0.7383 | 1.6324 | -200.3754 | -181.1734 | -2.1635 | -2.2023 |
| 0.0911 | 2.7778 | 200 | 0.5503 | -2.5532 | -4.2135 | 0.7227 | 1.6603 | -202.8217 | -183.3405 | -2.2203 | -2.2570 |