A more easy-to-use implementation of KPConv

This repo contains a more easy-to-use implementation of KPConv based on PyTorch.

Introduction

KPConv is a powerfull point convolution for point cloud processing. However, the original PyTorch implementation of KPConv has the following drawbacks:

1. It relies on heavy data preprocessing in the dataloader collate_fn to downsample the input point clouds, so one has to rewrite the collate_fn to work with KPConv. And the data processing is computed on CPU, which may be slow if the point clouds are large (e.g., KITTI).
2. The network architecture and the configurations of KPConv is fixed in the config file, and only single-branch FCN architecture is supported. For more complicated tasks, this is inflexible to build up multi-branch networks.

To use KPConv in more complicated networks, we build this repo with the following modifications:

1. GPU-based grid subsampling and radius neighbor searching. To accelerate kNN searching, we use KeOps. This enables us to decouple grid subsampling with data loading.
2. Rebuilt KPConv interface. This enables us to insert KPConv anywhere in the network. All KPConv modules are rewritten to accept four inputs:
   1. s_feats: features of the support points.
   2. q_points: coordinates of the query points.
   3. s_points: coordinates of the support points.
   4. neighbor_indices: the indices of the neighbors for the query points.
3. Optional normalization with a simple argument: None, BatchNorm, InstanceNorm, GroupNorm and LayerNorm.
4. Optional activation with a simple argument: None, ReLU, LeakyReLU, ELU, GELU, Sigmoid, Softplus, Tanh, Identity.

Installation

Use the following command for installation:

python setup.py develop

Example: S3DIS Scene Segmentation

We provide an example on S3DIS scene segmentation task in examples/scene_segmentation.

1. Install dependencies

We use Vision3d-Engine for training and testing. Refer to Vision3d-Engine for installation.

2. Data preprocesing

1. Download data from S3DIS official site.
2. Run examples/scene_segmentation/preprocess_s3dis.py for data preprocessing.

3. Training

python trainval.py --test_area=Area_5

4. Testing

python test.py --test_epoch=EPOCH_ID --test_area=Area_5

Acknowledgements

1. KPConv-PyTorch
2. KeOps