HEDNet icon indicating copy to clipboard operation
HEDNet copied to clipboard

HEDNet (NeurIPS 2023) & SAFDNet (CVPR 2024 Oral)

HEDNet

It is the official code release of HEDNet, which achieves state-of-the-art performance on large-scale Waymo Open Dataset.

TODO

We will release the code of SAFDNet (a fully sparse detector) in the same repo in early April.

Changelog

[2023-12-25] NEW: Initial code release.

Results on Waymo Open

We implemented HEDNet on Waymo Open based on OpenPCDet.

Validation set

Model L1 mAP/mAPH L2 mAP/mAPH Vec_L1 Vec_L2 Ped_L1 Ped_L2 Cyc_L1 Cyc_L2
HEDNet 81.4/79.5 75.3/73.4 81.1/80.6 73.2/72.7 84.4/80.0 76.8/72.6 78.7/77.7 75.8/74.9

Test set

Model L1 mAP/mAPH L2 mAP/mAPH Vec_L1 Vec_L2 Ped_L1 Ped_L2 Cyc_L1 Cyc_L2
HEDNet 82.2/80.2 76.9/75.0 84.2/83.8 77.0/76.6 84.1/79.7 78.3/74.0 78.2/77.0 75.4/74.3

We could not provide the above pretrained models due to Waymo Dataset License Agreement.

Results on NuScenes

We implemented HEDNet on NuScenes based on mmdetection3d, because the TransFusion-L implemented on OpenPCDet achieved lower accuracy than on mmdetection3d. We will unify the code in the future.

Validation set

Model mATE mASE mAOE mAVE mAAE mAP NDS download
HEDNet 27.5 25.1 26.3 23.3 18.7 67.0 71.4 ckpt

Test set

Model mATE mASE mAOE mAVE mAAE mAP NDS download
HEDNet 25.0 23.8 31.7 24.0 13.0 67.5 72.0 json

Installation and usage

For OpenPCDet, please refer to INSTALL.md and GETTING_STARTED.md for the installation and usage, respectively. We used python 3.8, pytorch 1.10, cuda11.3, spconv-cu113 2.3.3.

For HEDNet on nuScenes, we release the code in another repository, please refer to HEDNet-nusc.

Citation

@inproceedings{
  zhang2023hednet,
  title={{HEDN}et: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Clouds},
  author={Gang Zhang and Chen Junnan and Guohuan Gao and Jianmin Li and Xiaolin Hu},
  booktitle={Thirty-seventh Conference on Neural Information Processing Systems},
  year={2023},
}

Acknowleadgement

This work was supported in part by the National Key Research and Development Program of China (No. 2021ZD0200301) and the National Natural Science Foundation of China (Nos. U19B2034, 61836014) and THU-Bosch JCML center.