Downloads · 30 days
115
4% of all-time downloads
llava-phi-2-3b
marianna13/llava-phi-2-3b
llava-phi-2-3b is a text generation model from marianna13. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
- Developed by: LAION, SkunkworksAI & Ontocord - Model type: LLaVA is an open-source chatbot trained by fine-tuning Phi-2 on GPT-generated multimodal instruction-following data. It is an auto-regressive language model…
All-time downloads
2.7K
Public
Parameters
2.8B
25.7 GB on disk
Likes
14
Public
Repo makeup
Click a slice to open those files.
.safetensors11.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- phi-llava
- Access
- Public
- Created
- Jan 28, 2024
- Updated
- Jan 29, 2024
- SHA
- 1929e5e1
Try a prompt
Model card
From the Hugging Face model README
Model Card for LLaVa-Phi-2-3B
<!-- Provide a quick summary of what the model is/does. -->Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->- Developed by: LAION, SkunkworksAI & Ontocord
- Model type: LLaVA is an open-source chatbot trained by fine-tuning Phi-2 on GPT-generated multimodal instruction-following data. It is an auto-regressive language model, based on the transformer architecture
- Finetuned from model: Phi-2
- License: MIT
- Demo: llava-phi-2-3b-demo
Model Sources
<!-- Provide the basic links for the model. -->- Repository: BakLLaVa
Evaluation
<!-- This section describes the evaluation protocols and provides the results. -->Benchmarks
| Model | Parameters | SQA | GQA | TextVQA | POPE |
|---|---|---|---|---|---|
| LLaVA-1.5 | 7.3B | 68.0 | 62.0 | 58.3 | 85.3 |
| MC-LLaVA-3B | 3B | - | 49.6 | 38.59 | - |
| LLaVA-Phi | 3B | 68.4 | - | 48.6 | 85.0 |
| moondream1 | 1.6B | - | 56.3 | 39.8 | - |
| llava-phi-2-3b | 3B | 69.0 | 51.2 | 47.0 | 86.0 |
Image Captioning (MS COCO)
| Model | BLEU_1 | BLEU_2 | BLEU_3 | BLEU_4 | METEOR | ROUGE_L | CIDEr | SPICE |
|---|---|---|---|---|---|---|---|---|
| llava-1.5-7b | 75.8 | 59.8 | 45 | 33.3 | 29.4 | 57.7 | 108.8 | 23.5 |
| llava-phi-2-3b | 67.7 | 50.5 | 35.7 | 24.2 | 27.0 | 52.4 | 85.0 | 20.7 |
- Task
- Text Generation
- Library
- transformers
- Type
- phi-llava
- License
- mit
- Languages
- en
- Created
- Jan 28, 2024
- Updated
- Jan 29, 2024