phi-JEPA

phi-JEPA: Where and What to Reconstruct in Physics-Informed Radar Pre-training?

This is the official model repository for phi-JEPA, a physics-informed masked autoencoder for self-supervised synthetic aperture radar (SAR) image pre-training.

Release status. This repository currently provides the pretrained checkpoint used in our main experiments. The pre-training code and downstream evaluation code are not included in the current release.

Model Description

Existing masked image modeling methods for SAR imagery commonly rely on random masking and low-level reconstruction targets. phi-JEPA introduces two SAR-oriented designs:

1. Scattering-Center-Aware Masked Modeling (SCM). A physical scattering prior reconstructed from attributed scattering centers guides masking toward target-related regions while maintaining a high overall masking ratio.
2. SAR-Specific Semantic Feature Prediction (SFP). A frozen SARCLIP ViT-B/16 image encoder provides patch-level semantic targets, shifting the pre-training objective from low-level appearance reconstruction to semantic representation learning.

The released ViT-B/16 checkpoint is pretrained on ATRNet-STAR and is intended for downstream SAR representation transfer.

Released Checkpoint

Download

Using the Hugging Face CLI:

hf download kiki-orb/phi-JEPA \
  main_experiments/phi_jepa_vitb16_e100.pth \
  --local-dir ./checkpoints

Using Python:

from huggingface_hub import hf_hub_download

checkpoint_path = hf_hub_download(
    repo_id="kiki-orb/phi-JEPA",
    filename="main_experiments/phi_jepa_vitb16_e100.pth",
)
print(checkpoint_path)

Pre-training Configuration