Downloads · 30 days
7
9% of all-time downloads
visual-grounding-adapter
ishanmakkar/visual-grounding-adapter
visual-grounding-adapter is a machine learning model from ishanmakkar. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
Fine-tuned adapter for Qwen2-VL-7B for visual grounding tasks.
All-time downloads
78
Public
Repo size
819 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors162 MB · 91%
At a glance
- Library
- peft
- Access
- Public
- Created
- Nov 24, 2025
- Updated
- Dec 2, 2025
- SHA
- 96f7cd79
Base models
Model card
From the Hugging Face model README
Visual Grounding Adapter
Fine-tuned adapter for Qwen2-VL-7B for visual grounding tasks.
Usage
from transformers import Qwen2VLForConditionalGeneration, AutoProcessor
from peft import PeftModel
import torch
# Load base
model = Qwen2VLForConditionalGeneration.from_pretrained(
"Qwen/Qwen2-VL-7B-Instruct",
device_map="auto",
torch_dtype=torch.float16
)
# Load adapter
model = PeftModel.from_pretrained(model, "YOUR_USERNAME/visual-grounding-adapter")
processor = AutoProcessor.from_pretrained("Qwen/Qwen2-VL-7B-Instruct")
Training
- Dataset: Custom diagrams with bounding boxes
- LoRA rank: 8-16
- Epochs: 2-3
- Hardware: Google Colab T4
- Library
- peft
- Created
- Nov 24, 2025
- Updated
- Dec 2, 2025