Evaluation Code

[haomengz]

Hi,

Thanks for the nice work! I am interested in reproducing the results, but the evaluation procedure in the repo is not very clear. It seems that we could not directly use the linked ST-P3 eval code. Could you provide the script or more details on how you conduct the evaluate on NuScenes dataset? Thanks!

[abhigoku10]

@PointsCoder i am having the same issue here can u point or elaborate the steps to do the evaluation on nuscenes or custom dataset THanks in advance

[haomengz]

For the collision evaluation, ST-P3 is using segmentations for calculation. What segmentation results are you using for the calculation? Did you follow the ST-P3 pipeline, or using the data from UniAD? Thanks!

[Gear420]

same issue; .pkl cannot be directly applied to the evaluation code of st-p3.

[PointsCoder]

@abhigoku10 @haomengz @Gear420 We have released the code and data for evaluation here.