Downloads · 30 days
5
13% of all-time downloads
akazen/paligemma-3b-vizwizv-16Q
paligemma-3b-vizwizv-16Q is a machine learning model from akazen. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a 16-bit quantized version of google/paligemma-3b-ft-vizwizvqa-224, fine-tuned for visual question answering on the VizWiz dataset.
Downloads · 30 days
5
13% of all-time downloads
All-time downloads
39
Public
Parameters
2.9B
5.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.8 GB · 99%
From the Hugging Face model README
This is a 16-bit quantized version of google/paligemma-3b-ft-vizwizvqa-224, fine-tuned for visual question answering on the VizWiz dataset.
from transformers import AutoProcessor, AutoModelForImageTextToText
from PIL import Image
processor = AutoProcessor.from_pretrained("akazen/paligemma-3b-ft-vizwizvqa-16bit")
model = AutoModelForImageTextToText.from_pretrained(
"akazen/paligemma-3b-ft-vizwizvqa-16bit",
device_map="auto"
)
# Process an image
image = Image.open("your_image.jpg").convert("RGB")
question = "What's in this image?"
prompt = f"<image>\nQuestion: {question}\nAnswer:"
inputs = processor(images=image, text=prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=20)
answer = processor.decode(outputs[0], skip_special_tokens=True)