waymo-open-dataset
waymo-open-dataset copied to clipboard
Evaluation on server not working
Hi,
I submitted my results for the validation set of the occupancy flow prediction challenge on the website two days ago. However, it seems that the evaluation is not working, and I still get the following error message:
From my experience before the challenge deadline, this message shows when the evaluation is running on the server. Once it finishes (after about 10 min), we should see the result. Is there any problem with the evaluation server, or is it shut down after the challenge is finished?
Hi, I still can't get the evaluation result on the evaluation server. According to the homepage, the leaderboard is still open for submission:
. I also see some new submissions on other tasks after the end of the challenges.
Could you please fix the problem for the occupancy and flow prediction task? We want to use the new evaluation result in a potential publication.
Best regards
Have the same issue with my submissions earlier this week:
Is there any plan to fix the problem? Thanks in advance.
Bumping this, my submisions to occupancy flow aren't getting processed either. I accidentally submitted one to Motion Prediction and recieved quick feedback that it was in the wrong format.
The metrics server issue should be fixed. Please let us know if you are having any issues.