Downloads · 30 days
34
2% of all-time downloads
GPT-Vision
damerajee/GPT-Vision
GPT-Vision is a machine learning model from damerajee. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
A very small Vision-Lanaguge Model , Like Llava and Moondream This model has THREE components combined into one GPT2 VIT-224 Multimodality-projector
All-time downloads
2K
Public
Parameters
216M
1.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors862 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- gptvision
- Access
- Public
- Created
- Jul 22, 2024
- Updated
- Aug 5, 2024
- SHA
- e89c6b99
Datasets
Model card
From the Hugging Face model README
GPT-Vision
A very small Vision-Lanaguge Model , Like Llava and Moondream This model has THREE components combined into one
- GPT2
- VIT-224
- Multimodality-projector
Check the github for more information GPT-Vision-Github
Inference
from transformers import AutoModelForCausalLM
from PIL import Image
model = AutoModelForCausalLM.from_pretrained("damerajee/GPT-Vision", trust_remote_code=True)
image_path = "Your_image_path"
image = Image.open(image_path)
image = image.convert('RGB')
question = "Render a clear and concise summary of the photo."
answer = model.generate(image=image,question=question,max_new_tokens=40)
print("Answer:", answer)
Limitations
A fair warning tho guys , this model is only able to generate very short response sometimes it can also repetitive generate the same tokens but even thought it will understands whats on the image
Further Fine-tuning will make this model better
- Library
- transformers
- Type
- gptvision
- License
- apache-2.0
- Languages
- en
- Created
- Jul 22, 2024
- Updated
- Aug 5, 2024