OpenPCDet The storage to store the processed waymo dataset?

The storage to store the processed waymo dataset?

Open sjtuljw520 opened this issue 2 years ago • 7 comments

The raw waymo dataset is about 1 T, and how much storage needed to store the processed waymo dataset?

Aug 19 '22 06:08 sjtuljw520

Around ~500GB

Aug 19 '22 10:08 d33dler

Thank you! The number of samples of the processed dataset is 20% of the raw data, so the storage is reduced?

Aug 19 '22 10:08 sjtuljw520

@d33dler

Aug 19 '22 10:08 sjtuljw520

It depends on the sampling fraction from the dataset config, also the clouds sizes are reduced to your own configs size afaik

Aug 19 '22 11:08 d33dler

It consumes about 630GB in my server (the directory waymo_processed_data_v0_5_0).

Aug 20 '22 17:08 sshaoshuai

Thank you! Does the 630GB contain all point cloud samples or just a portion, for example, 20% ? @sshaoshuai

Aug 22 '22 02:08 sjtuljw520

This issue is stale because it has been open for 30 days with no activity.

Sep 22 '22 02:09 github-actions[bot]

It contains 100% samples.

Sep 26 '22 10:09 sshaoshuai