Downloads · 30 days
48
6% of all-time downloads
llava-llama-3-8b-v1_1-4bit
mlx-community/llava-llama-3-8b-v1_1-4bit
llava-llama-3-8b-v1_1-4bit is a image-text-to-text model from mlx-community. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for xtuner.
This model was converted to MLX format from xtuner/llava-llama-3-8b-v11-transformers using mlx-vllm version 0.0.3. Refer to the original model card for more details on the model.
All-time downloads
838
Public
Parameters
8.4B
5.5 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors5.5 GB · 100%
Parameter types
How the weights are stored.
U327.8B · 94%
Try a prompt
Datasets
Model card
From the Hugging Face model README
mlx-community/llava-llama-3-8b-v1_1-4bit
This model was converted to MLX format from xtuner/llava-llama-3-8b-v1_1-transformers using mlx-vllm version 0.0.3.
Refer to the original model card for more details on the model.
Use with mlx
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/llava-llama-3-8b-v1_1-4bit --max-tokens 100 --temp 0.0
- Task
- Image-Text-to-Text
- Library
- xtuner
- Type
- llava
- Created
- Apr 30, 2024
- Updated
- Apr 30, 2024