LibrePEb16-cls

LibrePEb16-cls

Perception Encoder (PE) Core PE-Core-B/16-224 packaged for LibreYOLO.

PE Core is a dual-tower vision-language encoder: it maps images, text, and whole videos into one normalized embedding space, and classifies zero-shot from text prompts.

from libreyolo import LibreYOLO

# zero-shot classification
model = LibreYOLO("LibrePEb16-cls.pt")
model.set_classes(["a forklift", "an empty aisle", "a spill"])
r = model.predict("warehouse.jpg")[0]
print(model.names[r.probs.top1], float(r.probs.top1conf))

# embeddings: image, text, and whole video in one space
embedder = LibreYOLO("LibrePEb16-cls.pt", task="embed")
embedder.predict("photo.jpg")      # (1, 1024) image row
embedder.embed_text(["a dog"])     # (1, 1024) text row
embedder.predict("clip.mp4")       # (1, 1024) row for the whole clip

The bare canonical filename is the download trigger - there is no from_pretrained.

Specification

Source

• Upstream repository: timm/PE-Core-B-16
• Upstream revision: 0038414f37721c5eafc1a5e0da802d291c909de3
• Upstream license: Apache-2.0

This is a converted OpenCLIP-compatible PE Core checkpoint, not an unmodified official facebook/PE-Core-* package checkpoint.

Modifications

State-dict metadata wrap only (weights/convert_pe_weights.py): LibreYOLO checkpoint metadata is added and tensors are moved to CPU. Learned parameters are unchanged.

Parity against unmodified open_clip_torch==3.2.0 on float32 CPU is exact (max_abs_diff == 0.0) for image embeddings, text embeddings, zero-shot logits, and fixed-frame video embeddings.

License

Apache-2.0, inherited from the upstream weights. See LICENSE and NOTICE in this repository. You are responsible for complying with those terms.