pvcnn.s3dis-area5.mit-han-lab

Model card for pvcnn.s3dis-area5.mit-han-lab

A PVCNN point cloud semantic segmentation model (fused point branch and voxel branch). Trained on S3DIS (Area 5).

Model Details

• Model Type: Point cloud semantic segmentation
• Model Stats:
  • Params (M): 2.6
  • Input channels: 9
  • Classes: 13
  • Features: 1472
• Dataset: S3DIS (Area 5)
• Metrics: mIoU 57.51, OA 86.58
• Paper: Point-Voxel CNN for Efficient 3D Deep Learning
• Converted from: mit-han-lab/pvcnn (MIT)
• Library: torch-pointcloud

Install

pip install torch-pointcloud

Usage

import torch
import torch_pointcloud as tp
from torch_pointcloud.utils.data import collate

model, info = tp.create_model(
    "pvcnn.s3dis-area5.mit-han-lab",
    pretrained=True,
    return_info=True,
)
model = model.eval()

# synthetic sample with the keys a dataset provides
num_points = 8192
sample = {
    "pos": torch.randn(num_points, 3),
    "color": torch.rand(num_points, 3) * 255,
    "norm_pos": torch.rand(num_points, 3),
}
data = info["transform"](sample)
data = collate([data])

with torch.no_grad():
    logits = model(data.get("x"), data["pos"], data["batch"])

Feature extraction

with torch.no_grad():
    features = model.forward_features(data.get("x"), data["pos"], data["batch"])

model.reset_classifier(num_classes=0)
with torch.no_grad():
    features = model(data.get("x"), data["pos"], data["batch"])  # (N, 1472)

Citation

@inproceedings{liu2019pvcnn,
  title   = {Point-Voxel CNN for Efficient 3D Deep Learning},
  author  = {Zhijian Liu and Haotian Tang and Yujun Lin and Song Han},
  booktitle = {NeurIPS},
  year    = {2019}
}

@inproceedings{armeni2016s3dis,
  title     = {{3D} Semantic Parsing of Large-Scale Indoor Spaces},
  author    = {Armeni, Iro and Sener, Ozan and Zamir, Amir R. and Jiang, Helen and Brilakis, Ioannis and Fischer, Martin and Savarese, Silvio},
  booktitle = {CVPR},
  year      = {2016}
}

@software{dujardin2026pytorchpointcloud,
  author  = {Arthur Dujardin},
  title   = {PyTorch PointCloud},
  year    = {2026},
  doi     = {10.5281/zenodo.22159632},
  url     = {https://github.com/arthurdjn/pytorch-pointcloud},
}