sam3

SAM 3

This repository mirrors the official Segment Anything Model 3 (SAM 3) weights released by Meta Superintelligence Labs. SAM 3 is a unified foundation model for prompt-driven segmentation in images and videos. It supports open-vocabulary text prompts and visual prompts (points/boxes/masks). Compared to SAM 2, SAM 3 exhaustively segments each instance of a requested concept and reaches ~75–80% of human-level performance on the SA-CO benchmark (270K unique concepts).

Highlights

• Presence token improves discrimination between closely related prompts.
• Decoupled detector + tracker scales better for long video sequences.
• 4M+ automatically annotated concepts ensure broad coverage of open-world categories.

Original paper: SAM 3: Segment Anything with Concepts (Meta AI, 2024).
Resources: Project Page · Demo

Files Included

• sam3.safetensors — detector and tracker weights for image + video segmentation.
• Tokenizer/config assets should be copied from the official facebookresearch/sam3 repository; this mirror only repackages the safetensors weights for self-hosting.

Quickstart

pip install torch==2.7.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu126
pip install git+https://github.com/facebookresearch/sam3.git

python - <<'PY'
from sam3 import build_sam3_image_model
from sam3.model.sam3_image_processor import Sam3Processor
model = build_sam3_image_model(
    bpe_path="sam3/assets/bpe_simple_vocab_16e6.txt.gz",
    device="cuda",
    eval_mode=True,
    checkpoint_path="sam3.safetensors",
    load_from_HF=False,
)
processor = Sam3Processor(model, device="cuda")
state = processor.set_image("your_image.jpg")
state = processor.set_text_prompt("white bicycle", state)
print(state["masks"].shape)
PY

Integration Notes

These mirrored weights are used in the AILab SAM3 ComfyUI node (RMBG edition) to enable promptable segmentation workflows directly inside ComfyUI. The node loads sam3.safetensors, tokenizer assets, and the SAM3 processors locally, so the entire pipeline stays compatible even when offline.

License & Usage

• This mirror preserves Meta's original weights and is subject to the license on facebook/sam3. You must accept Meta's terms before downloading the official release.
• When hosting this file in your own Hugging Face repository, keep this notice and credit the original authors.
• Cite the SAM 3 paper for any research or product that builds upon these weights.