HEDNet
HEDNet copied to clipboard
HEDNet (NeurIPS 2023) & SAFDNet (CVPR 2024 Oral)
HEDNet
It is the official code release of HEDNet, which achieves state-of-the-art performance on large-scale Waymo Open Dataset.
TODO
We will release the code of SAFDNet (a fully sparse detector) in the same repo in early April.
Changelog
[2023-12-25] NEW: Initial code release.
Results on Waymo Open
We implemented HEDNet on Waymo Open based on OpenPCDet.
Validation set
| Model | L1 mAP/mAPH | L2 mAP/mAPH | Vec_L1 | Vec_L2 | Ped_L1 | Ped_L2 | Cyc_L1 | Cyc_L2 |
|---|---|---|---|---|---|---|---|---|
| HEDNet | 81.4/79.5 | 75.3/73.4 | 81.1/80.6 | 73.2/72.7 | 84.4/80.0 | 76.8/72.6 | 78.7/77.7 | 75.8/74.9 |
Test set
| Model | L1 mAP/mAPH | L2 mAP/mAPH | Vec_L1 | Vec_L2 | Ped_L1 | Ped_L2 | Cyc_L1 | Cyc_L2 |
|---|---|---|---|---|---|---|---|---|
| HEDNet | 82.2/80.2 | 76.9/75.0 | 84.2/83.8 | 77.0/76.6 | 84.1/79.7 | 78.3/74.0 | 78.2/77.0 | 75.4/74.3 |
We could not provide the above pretrained models due to Waymo Dataset License Agreement.
Results on NuScenes
We implemented HEDNet on NuScenes based on mmdetection3d, because the TransFusion-L implemented on OpenPCDet achieved lower accuracy than on mmdetection3d. We will unify the code in the future.
Validation set
| Model | mATE | mASE | mAOE | mAVE | mAAE | mAP | NDS | download |
|---|---|---|---|---|---|---|---|---|
| HEDNet | 27.5 | 25.1 | 26.3 | 23.3 | 18.7 | 67.0 | 71.4 | ckpt |
Test set
| Model | mATE | mASE | mAOE | mAVE | mAAE | mAP | NDS | download |
|---|---|---|---|---|---|---|---|---|
| HEDNet | 25.0 | 23.8 | 31.7 | 24.0 | 13.0 | 67.5 | 72.0 | json |
Installation and usage
For OpenPCDet, please refer to INSTALL.md and GETTING_STARTED.md for the installation and usage, respectively. We used python 3.8, pytorch 1.10, cuda11.3, spconv-cu113 2.3.3.
For HEDNet on nuScenes, we release the code in another repository, please refer to HEDNet-nusc.
Citation
@inproceedings{
zhang2023hednet,
title={{HEDN}et: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Clouds},
author={Gang Zhang and Chen Junnan and Guohuan Gao and Jianmin Li and Xiaolin Hu},
booktitle={Thirty-seventh Conference on Neural Information Processing Systems},
year={2023},
}
Acknowleadgement
This work was supported in part by the National Key Research and Development Program of China (No. 2021ZD0200301) and the National Natural Science Foundation of China (Nos. U19B2034, 61836014) and THU-Bosch JCML center.