Downloads · 30 days
101
2% of all-time downloads
LLaVA-Meta-Llama-3-8B-Instruct
MBZUAI/LLaVA-Meta-Llama-3-8B-Instruct
LLaVA-Meta-Llama-3-8B-Instruct is a text generation model from MBZUAI. Use it when you need the model to write or continue text. It is set up for transformers.
[](https://github.com/mbzuai-oryx/LLaVA-pp)
All-time downloads
4.1K
Public
Parameters
8.4B
16.7 GB on disk
Likes
12
Public
Repo makeup
Click a slice to open those files.
.safetensors16.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llava_llama
- Access
- Public
- Created
- Apr 26, 2024
- Updated
- Apr 27, 2024
- SHA
- 7491659c
Try a prompt
Model card
From the Hugging Face model README
LLaMA-3-V: Extending the Visual Capabilities of LLaVA with Meta-Llama-3-8B-Instruct
Repository Overview
This repository features LLaVA v1.5 trained with the Meta-Llama-3-8B-Instruct LLM. This integration aims to leverage the strengths of both models to offer advanced vision-language understanding.
Training Strategy
- Pretraining: Only Vision-to-Language projector is trained. The rest of the model is frozen.
- Fine-tuning: LLM is LoRA fine-tuned. Only the vision-backbone (CLIP) is kept frozen.
- Note: The repository contains merged weights.
Key Components
- Base Large Language Model (LLM): Meta-Llama-3-8B-Instruct
- Base Large Multimodal Model (LMM): LLaVA-v1.5
Training Data
- Pretraining Dataset: LCS-558K
- Fine-tuning Dataset: LLaVA-Instruct-665K
Download It As
git lfs install
git clone https://huggingface.co/MBZUAI/LLaVA-Meta-Llama-3-8B-Instruct
Contributions
Contributions are welcome! Please 🌟 our repository LLaVA++ if you find this model useful.
- Task
- Text Generation
- Library
- transformers
- Type
- llava_llama
- Created
- Apr 26, 2024
- Updated
- Apr 27, 2024