Downloads · 30 days
83
1% of all-time downloads
llava-phi-2-3b-GGUF
marianna13/llava-phi-2-3b-GGUF
llava-phi-2-3b-GGUF is a machine learning model from marianna13. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
Quantized version of llava-phi-2-3b. Quantization was done using llama.cpp
All-time downloads
5.5K
Public
Repo size
6.2 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf6.2 GB · 100%
At a glance
- Library
- transformers
- License
- mit
- Access
- Public
- Created
- Feb 11, 2024
- Updated
- Feb 11, 2024
- SHA
- 19046ef6
Model card
From the Hugging Face model README
Model Card for LLaVa-Phi-2-3B-GGUF
<!-- Provide a quick summary of what the model is/does. -->Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->Quantized version of llava-phi-2-3b. Quantization was done using llama.cpp
- Developed by: LAION, SkunkworksAI & Ontocord
- Model type: LLaVA is an open-source chatbot trained by fine-tuning Phi-2 on GPT-generated multimodal instruction-following data. It is an auto-regressive language model, based on the transformer architecture
- Finetuned from model: Phi-2
- License: MIT
Model Sources
<!-- Provide the basic links for the model. -->Usage
make & ./llava-cli -m ../ggml-model-f16.gguf --mmproj ../mmproj-model-f16.gguf --image /path/to/image.jpg
Evaluation
<!-- This section describes the evaluation protocols and provides the results. -->Benchmarks
| Model | Parameters | SQA | GQA | TextVQA | POPE |
|---|---|---|---|---|---|
| LLaVA-1.5 | 7.3B | 68.0 | 62.0 | 58.3 | 85.3 |
| MC-LLaVA-3B | 3B | - | 49.6 | 38.59 | - |
| LLaVA-Phi | 3B | 68.4 | - | 48.6 | 85.0 |
| moondream1 | 1.6B | - | 56.3 | 39.8 | - |
| llava-phi-2-3b | 3B | 69.0 | 51.2 | 47.0 | 86.0 |
Image Captioning (MS COCO)
| Model | BLEU_1 | BLEU_2 | BLEU_3 | BLEU_4 | METEOR | ROUGE_L | CIDEr | SPICE |
|---|---|---|---|---|---|---|---|---|
| llava-1.5-7b | 75.8 | 59.8 | 45 | 33.3 | 29.4 | 57.7 | 108.8 | 23.5 |
| llava-phi-2-3b | 67.7 | 50.5 | 35.7 | 24.2 | 27.0 | 52.4 | 85.0 | 20.7 |
- Library
- transformers
- License
- mit
- Languages
- en
- Created
- Feb 11, 2024
- Updated
- Feb 11, 2024