Downloads · 30 days
101
0% of all-time downloads
lavida-llada-v1.0-instruct-hf-transformers
KonstantinosKK/lavida-llada-v1.0-instruct-hf-transformers
lavida-llada-v1.0-instruct-hf-transformers is a image-text-to-text model from KonstantinosKK. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
[[Github]](https://github.com/jacklishufan/LaViDa)[[Paper]](paper/paper.pdf) [[Arxiv]](https://arxiv.org/abs/2505.16839) [[Checkpoints]](https://huggingface.co/collections/jacklishufan/lavida-10-682ecf5a5fa8c5df85c61d…
All-time downloads
25.9K
Public
Parameters
8.4B
16.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.9 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- apache-2.0
- Model type
- llava_llada
- Access
- Public
- Created
- Jun 7, 2025
- Updated
- Jun 13, 2025
- SHA
- 6abbe20c
Try a prompt
Model card
From the Hugging Face model README
LaViDa-LLaDa v1.0 Instruct (Transformers-Compatible)
[Github][Paper] [Arxiv] [Checkpoints] [Data] [Website]
This is a transformers-compatible version of the LaViDa-LLaDa checkpoint. It allows direct loading via Huggingface transformers APIs for easier inference and integration.
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
tokenizer = AutoTokenizer.from_pretrained('./lavida-llada-v1.0-instruct/')
model = AutoModelForCausalLM.from_pretrained('./lavida-llada-v1.0-instruct/', torch_dtype=torch.bfloat16)
image_processor = model.get_vision_tower().image_processor
model.resize_token_embeddings(len(tokenizer))
model.tie_weights()
License
Apache 2.0
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- llava_llada
- License
- apache-2.0
- Created
- Jun 7, 2025
- Updated
- Jun 13, 2025