waymo-open-dataset
waymo-open-dataset copied to clipboard
waymo-research
Occupancy and flow challenge - submission fails
I run the occupancy_and_flow_tutorial directly and submit the generated submission to the server (Validation server, not the Test one). However, it seems that the server is not working(stuck more than 12 hours). Any advice on this situation?
Hi,
Thank you for your interest in the challenge and for communicating with us. This is a known issue and we are working on resolving it. The results will automatically show up once your submission is processed.
Is there any possible delay of the competition ddl, since the server is still not working and there's only about 1 month left @rezama
Thank you for your interest. I wouldn't expect the deadline to change.
I don't see any new submissions from you after the last one which we evaluated. The evaluation results for your 3 existing submissions should show up on the website by end of day.
@rezama Hi rezama, we've encountered this problem again. Specifically, we follow the tutorial to generate the groundtruth of validation set. To validate its correctness and avoid potential risk of incorrect gt, we directly submit the generated gt to online evaluation server. Its expected to have very good results as we are submitting validation gt not prediction. Unfortunately, there's still nothing shown on website. Is it ok to send me the results through email? Thank you. [email protected]
We have evaluated the new submissions from you. You have sent 5 in total. One of them has invalid scenario ids -- probably the test set results were submitted on the validation form. The other 4 submissions should have evaluation results under 'My Submissions' for you. Could you share a screenshot from your My Submissions and the results? Thanks.
Thank you for your hard work, now we can see the results on the website, and the scores are resonable.
Note that the lastest submission is the validation groundtruth, we just want to make sure our generated gt is correct.
@rezama Hi rezama, i met the same question as author, i've submitted my submission two days ago, but it shows the same results as author what shows The submission could not be found! Could you give me some help! Thanks!!
