Downloads · 30 days
0
PaliGemma-VQAv2-Lora-finetuned
ayoubkirouane/PaliGemma-VQAv2-Lora-finetuned
PaliGemma-VQAv2-Lora-finetuned is a image-text-to-text model from ayoubkirouane. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as gemma.
Access
Public
Updated Jul 3, 2024
Repo size
45.3 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors45.3 MB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- gemma
- Access
- Public
- Created
- Jul 3, 2024
- Updated
- Jul 3, 2024
- SHA
- dbca04c6
Try a prompt
Datasets
Model card
From the Hugging Face model README
Base model :
- google/paligemma-3b-pt-224
Dataset :
- HuggingFaceM4/VQAv2
Getting started :
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM
config = PeftConfig.from_pretrained("ayoubkirouane/PaliGemma-VQAv2-Lora-finetuned")
base_model = AutoModelForCausalLM.from_pretrained("google/paligemma-3b-pt-224")
model = PeftModel.from_pretrained(base_model, "ayoubkirouane/PaliGemma-VQAv2-Lora-finetuned")
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- gemma
- Languages
- en
- Created
- Jul 3, 2024
- Updated
- Jul 3, 2024