argoverse-api icon indicating copy to clipboard operation
argoverse-api copied to clipboard

Is It Possible To Use Merely Part Of The Datasets

Open yuxinl915 opened this issue 2 years ago • 1 comments

To whom it may concern,

Thanks so much for providing the APIs for argoverse! They are amazing! However, I got one question related to our dataset. I am currently replicating a paper and would like to download Argoverse 2 Motion Forecasting Dataset for training and validating. The only available equipment so far is my laptop without discrete graphics. Therefore, I am curious whether there is a way that I can download just part of the dataset. For example, the whole dataset for motion forecasting is in size 58G. So could I download only 1 or 2G of it, which might be a more suitable size for training the model on a laptop? Or could you please give me some advice? I really appreciate any help you can provide!

yuxinl915 avatar Aug 01 '22 22:08 yuxinl915

Hi @yuxinl915, please refer to the instructions listed here: https://github.com/argoai/av2-api/blob/main/DOWNLOAD.md. You should be able to download individual scenarios.

An example:

s5cmd --no-sign-request cp s3://argoai-argoverse/av2/motion-forecasting/train/0dfbd3aa-467e-46b7-8da8-ca289132ac28/* ~/Downloads/

benjaminrwilson avatar Aug 02 '22 16:08 benjaminrwilson