point-m2ae-base.shapenetpart.renrui-zhang

Model card for point-m2ae-base.shapenetpart.renrui-zhang

A Point-M2AE point cloud part segmentation model (multi-scale masked autoencoder). Trained on ShapeNetPart.

Model Details

• Model Type: Point cloud part segmentation
• Model Stats:
  • Params (M): 25.5
  • Classes: 50
  • Features: 6208
• Dataset: ShapeNetPart
• Metrics: ins_mIoU 86.17, cls_mIoU 84.6
• Paper: Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training
• Converted from: ZrrSkywalker/Point-M2AE (MIT)
• Library: torch-pointcloud

Install

pip install torch-pointcloud

Usage

import torch
import torch_pointcloud as tp
from torch_pointcloud.utils.data import collate

model, info = tp.create_model(
    "point-m2ae-base.shapenetpart.renrui-zhang",
    pretrained=True,
    return_info=True,
)
model = model.eval()

# synthetic sample with the keys a dataset provides
num_points = 8192
sample = {
    "pos": torch.randn(num_points, 3),
    "normal": torch.randn(num_points, 3),
    "category": torch.tensor(0),
    "segment": torch.zeros(num_points, dtype=torch.long),
}
data = info["transform"](sample)
data = collate([data])

with torch.no_grad():
    logits = model(data.get("x"), data["pos"], data["batch"], data["category"])

Feature extraction

with torch.no_grad():
    features = model.forward_features(data.get("x"), data["pos"], data["batch"])

model.reset_classifier(num_classes=0)
with torch.no_grad():
    features = model(data.get("x"), data["pos"], data["batch"], data["category"])  # (N, 6208)

Citation

@inproceedings{zhang2022pointm2ae,
  title   = {Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training},
  author  = {Renrui Zhang and Ziyu Guo and Rongyao Fang and Bin Zhao and Dong Wang and Yu Qiao and Hongsheng Li and Peng Gao},
  booktitle = {NeurIPS},
  year    = {2022}
}

@article{yi2016shapenetpart,
  title   = {A Scalable Active Framework for Region Annotation in {3D} Shape Collections},
  author  = {Yi, Li and Kim, Vladimir G. and Ceylan, Duygu and Shen, I-Chao and Yan, Mengyan and Su, Hao and Lu, Cewu and Huang, Qixing and Sheffer, Alla and Guibas, Leonidas},
  journal = {ACM Transactions on Graphics (TOG)},
  volume  = {35},
  number  = {6},
  year    = {2016}
}

@software{dujardin2026pytorchpointcloud,
  author  = {Arthur Dujardin},
  title   = {PyTorch PointCloud},
  year    = {2026},
  doi     = {10.5281/zenodo.22159632},
  url     = {https://github.com/arthurdjn/pytorch-pointcloud},
}