Downloads · 30 days
25
3% of all-time downloads
saphvis/LLaVA_MORE-llama_3_1-8B-finetuning-FP16-mmproj-GGUF
LLaVA_MORE-llama_3_1-8B-finetuning-FP16-mmproj-GGUF is a image-text-to-text model from saphvis. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
FP16 GGUF of the LLaVaMORE 3.1 8B finetuning mmproj
Downloads · 30 days
25
3% of all-time downloads
All-time downloads
880
Public
Repo size
624 MB
Likes
1
Public
Click a slice to open those files.
.gguf624 MB · 100%
From the Hugging Face model README
FP16 GGUF of the LLaVa_MORE 3.1 8B finetuning mmproj
Original Model Card:
LLaVA-MORE enhances the well-known LLaVA architecture by integrating the use of LLaMA 3.1 as the language model. We are publicly releasing the checkpoints for stages one and two for the first model with 8B parameters.
In this model space, you will find the stage two (finetuning) weights of LLaVA-MORE LLaMA 3.1 8B.
For more information, visit our LLaVA-MORE repository.
You can try our LLaVA-MORE in the Image-To-Text task by cloning our repository and running the following script.
python -u llava/eval/run_llava.py
If you make use of our work, please cite our repo:
@misc{cocchi2024llavamore,
title={{LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1}},
author={Cocchi, Federico and Moratelli, Nicholas and Caffagni, Davide and Sarto, Sara and Cornia, Marcella and Baraldi, Lorenzo and Cucchiara, Rita},
url={https://github.com/aimagelab/LLaVA-MORE},
year={2024}
}