Results 12 comments of Shashank Ojha

Do you know which file out of validation-XXXXX-of_00150 that scenario exists in? It would help me find that particular scenario in the data.

Nevermind, I found it. You're right that there was a small bug in my submission. Let me resubmit and retry.

@scott-ettinger, we tried to make another submission just to ensure local and cloud match for sanity check purposes but we're getting some server failures ![image](https://github.com/waymo-research/waymo-open-dataset/assets/7075888/d434666e-8168-4d93-a647-63c865c3e9fc) http://type.googleapis.com/util.ErrorSpacePayload='RPC::UNREACHABLE' Do you think you...

@scott-ettinger thanks for the quick response in resolving the issue! So now we've successfully submitted the ground truth predictions to the Waymo servers and the results look as expected: ![image](https://github.com/waymo-research/waymo-open-dataset/assets/7075888/d1b83005-ab4b-4462-b671-ac3b3b073e22)...

Yeah, so I import `py_metrics_ops` from the WOMD github repo and call the `motion_metrics` function. I do this for each tf_example separately (i.e. Batch size is 1). I then manually...

Sure, let me know if I can provide any other information to assist in the process!

Yeah, the validation server works fine for now, but what is the plan to resolve it? Is this still something you all are looking into or are you closing the...