Contextual Point Cloud Modeling for Weakly-supervised Point Cloud Semantic Segmentation (ICCV 2023)

Created by Lizhao Liu, Xunlong Xiao, Zhuangwei Zhuang from the South China University of Technology.

This repository contains the official PyTorch implementation of our ICCV 2023 paper Contextual Point Cloud Modeling for Weakly-supervised Point Cloud Semantic Segmentation.

Environment Setup

Our codebase is based on MinkowskiEngine, a high performance sparse convolution library built on PyTorch.

We recommend to use MinkowskiEngine 0.5.4, since it is much faster than 0.4.3

For MinkowskiEngine 0.5.4, see instruction in me054

For MinkowskiEngine 0.4.3, see instruction in me043

Data Preparation

We perform experiments on the following dataset

• ScanNet V2
• S3DIS
• Semantic-KITTI (Front view that contains both RGB and XYZ)

The preprocessed datasets are shared via google drive

• ScanNet V2 (6.88G)
• S3DIS (3.15G)
• Semantic-KITTI (8.82G)

Or see instruction in Dataset Preparation Hand-by-hand to prepare by yourself.

Quantitative Results

All results below are in mIoU(%)

Experiments on the indoor dataset: ScanNet V2 and S3DIS

Experiments on the outdoor dataset SemanticKITTY (FoV)

Qualitative Results for ScanNet and S3DIS

• The first two rows are results for ScanNet, the last two rows are results for S3DIS

Experiments on S3DIS

To reproduce the results of S3DIS, see experiment scripts here for details.

Experiments on ScanNet V2

To reproduce the results of ScanNet V2, see experiment scripts here for details. The script that generates ScanNet testset results are also available here.

Experiments on SemanticKITTY (FoV)

To reproduce the results of ScanNet V2, see experiment scripts here for details.

Acknowledgement

This codebase is partially built on the PointContrast project.

Citation

If you find this code helpful for your research, please consider citing

@inproceedings{liu2023contextual,
  title={CPCM: Contextual point cloud modeling for weakly-supervised point cloud semantic segmentation},
  author={Liu, Lizhao and Zhuang, Zhuangwei and Huang, Shangxin and Xiao, Xunlong and Xiang Tianhang and Chen, Cen and Wang, Jingdong and Tan, Mingkui},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  year={2023}
}