Downloads · 30 days
3
15% of all-time downloads
coderop12/fnd-qwen2vl7b-stage-a
fnd-qwen2vl7b-stage-a is a machine learning model from coderop12. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as mit.
Goal: General image↔caption alignment on COCO 2017. Vision frozen; LoRA on language.
Downloads · 30 days
3
15% of all-time downloads
All-time downloads
20
Public
Repo size
334 MB
Likes
0
Public
Click a slice to open those files.
.safetensors323 MB · 95%
From the Hugging Face model README
Goal: General image↔caption alignment on COCO 2017. Vision frozen; LoRA on language.
from transformers import AutoProcessor, Qwen2VLForConditionalGeneration
from peft import PeftModel
base = Qwen2VLForConditionalGeneration.from_pretrained("Qwen/Qwen2-VL-7B-Instruct", device_map="auto", torch_dtype="auto", trust_remote_code=True)
proc = AutoProcessor.from_pretrained("coderop12/fnd-qwen2vl7b-stage-a", trust_remote_code=True)
model = PeftModel.from_pretrained(base, "coderop12/fnd-qwen2vl7b-stage-a").eval()
See metadata.json for training knobs.