3DTrans icon indicating copy to clipboard operation
3DTrans copied to clipboard

Waymo evaluation issue

Open mincheoree opened this issue 1 year ago • 6 comments

Hello, thanks for great works! During Waymo dataset evaluation, I encountered 0 mAP and GT objects. image I searched in PCDet issue, the author says that Waymo 1.0.0 is incompatible with evaluation, and they use Waymo 1.2.0 dataset as default, referring to this: https://github.com/open-mmlab/OpenPCDet/issues/1102

However, in your AD-PT paper, you mentioned that you used Waymo 1.0.0 as your experiment setting. As your codebase is based on PCDet, may I ask if you also encountered this 0 AP error during waymo evaluation? Is Waymo 1.0.0 okay for evaluation?

mincheoree avatar Jan 22 '24 08:01 mincheoree