LiDAR-Distillation
LiDAR-Distillation copied to clipboard
[ECCV 2022] LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detection
LiDAR Distillation
Paper | Model
LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detection
Yi Wei, Zibu Wei, Yongming Rao, Jiaxin Li, Jiwen Lu, Jie Zhou
Introduction
In this paper, we propose the LiDAR Distillation to bridge the domain gap induced by different LiDAR beams for 3D object detection. In many real-world applications, the LiDAR points used by mass-produced robots and vehicles usually have fewer beams than that in large-scale public datasets. Moreover, as the LiDARs are upgraded to other product models with different beam amount, it becomes challenging to utilize the labeled data captured by previous versions’ high-resolution sensors. Despite the recent progress on domain adaptive 3D detection, most methods struggle to eliminate the beam-induced domain gap.
Model Zoo
Cross-dataset Adaptation
model | method | AP_BEV | AP_3D |
---|---|---|---|
SECOND-IoU | Direct transfer | 32.91 | 17.24 |
SECOND-IoU | ST3D | 35.92 | 20.19 |
SECOND-IoU | Ours | 40.66 | 22.86 |
SECOND-IoU | Ours (w / ST3D) | 42.04 | 24.50 |
PV-RCNN | Direct transfer | 34.50 | 21.47 |
PV-RCNN | ST3D | 36.42 | 22.99 |
PV-RCNN | Ours | 43.31 | 25.63 |
PV-RCNN | Ours (w / ST3D) | 44.08 | 26.37 |
PointPillar | Direct transfer | 27.8 | 12.1 |
PointPillar | ST3D | 30.6 | 15.6 |
PointPillar | Ours | 40.23 | 19.12 |
PointPillar | Ours (w / ST3D) | 40.83 | 20.97 |
Results of cross-dataset adaptation from Waymo to nuScenes. The training Waymo data used in our work is version 1.0.
Single-dataset Adaptation
beams | method | AP_BEV | AP_3D |
---|---|---|---|
32 | Direct transfer | 79.81 | 65.91 |
32 | ST3D | 71.29 | 57.57 |
32 | Ours | 82.22 | 70.15 |
32* | Direct transfer | 73.56 | 57.77 |
32* | ST3D | 67.08 | 53.30 |
32* | Ours | 79.47 | 66.96 |
16 | Direct transfer | 64.91 | 47.48 |
16 | ST3D | 57.58 | 42.40 |
16 | Ours | 74.32 | 59.87 |
16* | Direct transfer | 56.32 | 38.75 |
16* | ST3D | 55.63 | 37.02 |
16* | Ours | 70.43 | 55.24 |
Results of single-dataset adaptation on KITTI dataset with PointPillars (moderate difficulty). For SECOND-IoU and PV-RCNN, we find that it is easy to raise cuda error on low-beam data, which is may caused by the bug in spconv. Thus, we do not provide the model but you can still run these experiments with the yamls.
Installation
Please refer to INSTALL.md.
Getting Started
Please refer to GETTING_STARTED.md.
License
Our code is released under the Apache 2.0 license.
Acknowledgement
Our code is heavily based on OpenPCDet v0.2 and ST3D. Thanks OpenPCDet Development Team for their awesome codebase.
Citation
If you find this project useful in your research, please consider cite:
@article{wei2022lidar,
title={LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detection},
author={Wei, Yi and Wei, Zibu and Rao, Yongming and Li, Jiaxin and Zhou, Jie and Lu, Jiwen},
journal={arXiv preprint arXiv:2203.14956},
year={2022}
}
@misc{openpcdet2020,
title={OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Clouds},
author={OpenPCDet Development Team},
howpublished = {\url{https://github.com/open-mmlab/OpenPCDet}},
year={2020}
}