waymo-open-dataset icon indicating copy to clipboard operation
waymo-open-dataset copied to clipboard

Cannot access v1.3.1 perception dataset

Open jb892 opened this issue 2 years ago • 16 comments

Hi,

I want to participate in the 2022 Waymo 3D Camera-Only Detection Challenge. However, I don't have permission to access the v1.3.1 perception dataset. The error msg pops out when I click the google cloud files link. error_msg

I'm not sure what's going on here. Please help! Thanks in advance!

jb892 avatar Apr 18 '22 03:04 jb892

I encountered the same issue.

alanxuefei avatar Apr 18 '22 05:04 alanxuefei

We are resolving the access issue and will update this thread in a day. Thank you for your patience.

zoeyyang1 avatar Apr 18 '22 06:04 zoeyyang1

Hi. So far, I still can't access the link. Could you please repair it? THX. @zoeyyang1

jiaweihe1996 avatar Apr 19 '22 06:04 jiaweihe1996

Our team is working at full speed to enable access. Thank you for your patience.

zoeyyang1 avatar Apr 19 '22 06:04 zoeyyang1

Hi all, we are excited to share that all registered users of the Waymo Open Dataset now have access to the latest version 1.3.1. Please find access to the dataset at waymo.com/open/download.

zoeyyang1 avatar Apr 23 '22 00:04 zoeyyang1

We also cannot find the both fields of 'camera_synced_box' and 'most_visible_camera_name' in the tfrecord file from waymo data v1.3.1. Are you sure the two fields are included in the new tfrecord file, and could you please check it? THX. @zoeyyang1

fcjian avatar Apr 24 '22 06:04 fcjian

Hi all, we are excited to share that all registered users of the Waymo Open Dataset now have access to the latest version 1.3.1. Please find access to the dataset at waymo.com/open/download.

Hi Zoey, will you update your bucket permission according to the latest roster, since I registered with my academic account with a Colab Pro.

jayhsu0627 avatar Apr 24 '22 08:04 jayhsu0627

@fcjian Hi, please install the latest pip package (pip version 1.4.5) and you should be able to find these fields.

zoeyyang1 avatar Apr 26 '22 07:04 zoeyyang1

@jayhsu0627 Hi, you should be able to access the dataset, once you register on the Waymo Open Dataset website (waymo.com/open) and receive a confirmation email that indicates a successful registration. Let me know if you run into any issues.

zoeyyang1 avatar Apr 26 '22 07:04 zoeyyang1

@fcjian Hi, please install the latest pip package (pip version 1.4.5) and you should be able to find these fields.

@zoeyyang1 would you to share the command?

The following command does not work.

!pip3 install waymo-open-dataset-tf-2-6-0==1.4.5

alanxuefei avatar Apr 26 '22 08:04 alanxuefei

@alanxuefei Same issue here.

image

Seems like the PyPI repository is not yet updated with the new version of waymo toolkit.

joonjeon avatar Apr 26 '22 08:04 joonjeon

@jayhsu0627 Hi, you should be able to access the dataset, once you register on the Waymo Open Dataset website (waymo.com/open) and receive a confirmation email that indicates a successful registration. Let me know if you run into any issues.

Hi Zoey, Thanks for your reply. I just checked my permission to the dataset with this email sxu [at] ucsc.edu is still not available.

jayhsu0627 avatar Apr 26 '22 09:04 jayhsu0627

1.4.5 can be obtained via a locally built PIP package.

However, frame.camera_labels[0].labels[0].camera_synced_box is empty. One training data is used. "segment-1005081002024129653_5313_150_5333_150_with_camera_labels.tfrecord"

alanxuefei avatar Apr 26 '22 12:04 alanxuefei

1.4.5 can be obtained via Build local PIP package. However, frame.camera_labels[0].labels[0].camera_synced_box is empty. One training data is used. "segment-1005081002024129653_5313_150_5333_150_with_camera_labels.tfrecord"

Hi, can you provide a more specific command to install 1.4.5 from Baidu local PIP package, I still can not obtain this version from 'https://mirror.baidu.com/pypi/simple'. Thank you.

At the end of the tutorial, there are steps for building a local PIP package. Not Baidu.

alanxuefei avatar Apr 26 '22 13:04 alanxuefei

The local built file is shared in the following link. https://github.com/alanxuefei/waymo/tree/main

However, the fields of camera_synced_box and most_visible_camera_name are missing. The issue is documented in https://github.com/waymo-research/waymo-open-dataset/issues/470

alanxuefei avatar Apr 26 '22 13:04 alanxuefei

Hi all, please find the pip package 1.4.5 here https://pypi.org/project/waymo-open-dataset-tf-2-6-0/1.4.5/#files. The most_visible_camera_name and camera_synced_box is not populated for every label. They are populated for boxes that are visible to the camera.

zoeyyang1 avatar Apr 28 '22 16:04 zoeyyang1