Downloads · 30 days
11
15% of all-time downloads
Llava-Phi2
sid819/Llava-Phi2
Llava-Phi2 is a visual question answering model from sid819. Use it for the visual question answering task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This is a multimodal implementation of Phi2 model inspired by LlaVA-Phi.
All-time downloads
74
Public
Parameters
2.8B
23.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors11.2 GB · 100%
At a glance
- Task
- Visual Question Answering
- Library
- transformers
- License
- mit
- Model type
- phi-llava
- Access
- Public
- Created
- Apr 15, 2024
- Updated
- Apr 15, 2024
- SHA
- 5d6c7baa
Model card
From the Hugging Face model README
Model Card for Model ID
This is a multimodal implementation of Phi2 model inspired by LlaVA-Phi.
Model Details
- LLM Backbone: Phi2
- Vision Tower: clip-vit-large-patch14-336
- Pretraining Dataset: LAION-CC-SBU dataset with BLIP captions(200k samples)
- Finetuning Dataset: Instruct 150k dataset based on COCO
- Finetuned Model: marianna13/llava-phi-2-3b
Model Sources
<!-- Provide the basic links for the model. -->- Original Repository: Llava-Phi
- Paper [optional]: LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Model
- Demo [optional]: Demo Link
- Task
- Visual Question Answering
- Library
- transformers
- Type
- phi-llava
- License
- mit
- Languages
- en
- Created
- Apr 15, 2024
- Updated
- Apr 15, 2024