siglip-person-search-openset

🔍 SigLIP Person Search - Open Set

This model is a fine-tuned version of google/siglip-base-patch16-224 for open-set person retrieval based on natural language descriptions. It's built to support image-text similarity in real-world retail and surveillance scenarios.

🧠 Use Case

This model allows you to search for people in crowded environments (like malls or stores) using only a text prompt, for example:

"A man wearing a white t-shirt and carrying a brown shoulder bag"

The model will return person crops that match the description.

💾 Training

• Base: google/siglip-base-patch16-224
• Loss: Cosine InfoNCE
• Data: ReID dataset with multimodal attributes (generated via Gemini)
• Epochs: 10
• Usage: Retrieval-style search (not classification)

📈 Intended Use

• Smart surveillance
• Anonymous retail behavior tracking
• Human-in-the-loop retrieval
• Visual search & retrieval systems

🔧 How to Use

from transformers import AutoProcessor, AutoModel
import torch

processor = AutoProcessor.from_pretrained("adonaivera/siglip-person-search-openset")
model = AutoModel.from_pretrained("adonaivera/siglip-person-search-openset")

text = "A man wearing a white t-shirt and carrying a brown shoulder bag"
inputs = processor(text=text, return_tensors="pt")
with torch.no_grad():
    text_features = model.get_text_features(**inputs)

📌 Notes

• This model is optimized for feature extraction and cosine similarity matching
• It's not meant for classification or image generation
• Similarity threshold tuning is required depending on your application