Downloads · 30 days
7
0% of all-time downloads
Gupta28/judgebench-siglip-judge-v1
judgebench-siglip-judge-v1 is a image feature extraction model from Gupta28. Use it for the image feature extraction task on the model card, and read the license before you ship it in a product.
Part of judgecliff: which image-QC judges survive optimization pressure? A brand-fidelity judge for rhode (beauty brand). A judge = these SigLIP weights + calibration.json (rhode train-split centroid + Platt scaling p…
Downloads · 30 days
7
0% of all-time downloads
All-time downloads
10.6K
Public
Parameters
878M
3.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.5 GB · 100%
From the Hugging Face model README
Part of judgecliff: which image-QC judges survive optimization pressure? A brand-fidelity judge for rhode (beauty brand). A judge = these SigLIP weights
calibration.json (rhode train-split centroid + Platt scaling params) in this repo.Base: google/siglip-so400m-patch14-384 (full SiglipModel, contrastively fine-tuned).
Training: SupCon contrastive fine-tune, rhode positives vs competitor-brand negatives (Glossier, ILIA and others), judgecliff train split. No violation negatives.
Report card (judgecliff Phase 1, 2,622-item test set): brand AUC 0.99, logo-masking delta 0.00 (style reader, not a wordmark reader), brand-dial Spearman 0.24, near-zero violation detection.
v1 learned the brand's center, not its boundaries: it is violation-blind, and under SRPO gradient pressure it was fully exploited (hacked images scored 0.84). See v2 (+violation negatives) and v3 (hardened) for the ablations.
Score = Platt-calibrated cosine similarity between the image embedding and the rhode centroid:
import json, numpy as np, torch
from PIL import Image
from transformers import SiglipModel, SiglipImageProcessor
from huggingface_hub import hf_hub_download
repo = "Gupta28/judgebench-siglip-judge-v1"
model = SiglipModel.from_pretrained(repo)
proc = SiglipImageProcessor.from_pretrained(repo)
params = json.load(open(hf_hub_download(repo, "calibration.json")))
centroid = np.array(params["centroid"]) # L2-normalized rhode train centroid
img = Image.open("image.jpg")
with torch.no_grad():
emb = model.get_image_features(**proc(images=img, return_tensors="pt"))
v = emb[0].numpy(); v /= np.linalg.norm(v)
cos = float(v @ centroid)
score = 1 / (1 + np.exp(-(params["platt_a"] * cos + params["platt_b"]))) # calibrated on-brand prob
Full evaluation protocol, test-set construction, and findings: https://github.com/amargupta0428/judgecliff.