viper_rl icon indicating copy to clipboard operation
viper_rl copied to clipboard

Trouble with acquiring the dataset (DMC)

Open luccachiang opened this issue 1 year ago • 4 comments

Hello Ale, thanks for your awosome work and I am really into it. However, when I follow your README I encounter some problems in the section 'Downloading Data'. I tried to run your python command on my Linux server but found the following exceptions:

Processing dataset download for dmc Saving dataset to: /root/misc/viper_rl/viper_rl_data/datasets dmc_dataset_aa: failed to retrieve item metadata - errors mv: cannot stat 'dmc_dataset_aa/dmc.tar.partaa': No such file or directory rmdir: failed to remove 'dmc_dataset_aa': No such file or directory dmc_dataset_ab: failed to retrieve item metadata - errors mv: cannot stat 'dmc_dataset_ab/dmc.tar.partab': No such file or directory rmdir: failed to remove 'dmc_dataset_ab': No such file or directory dmc_dataset_ac: failed to retrieve item metadata - errors mv: cannot stat 'dmc_dataset_ac/dmc.tar.partac': No such file or directory rmdir: failed to remove 'dmc_dataset_ac': No such file or directory dmc_dataset_ad: failed to retrieve item metadata - errors mv: cannot stat 'dmc_dataset_ad/dmc.tar.partad': No such file or directory rmdir: failed to remove 'dmc_dataset_ad': No such file or directory dmc_dataset_ae: failed to retrieve item metadata - errors mv: cannot stat 'dmc_dataset_ae/dmc.tar.partae': No such file or directory rmdir: failed to remove 'dmc_dataset_ae': No such file or directory cat: 'dmc.tar.part*': No such file or directory tar: This does not look like a tar archive tar: Exiting with failure status due to previous errors rm: cannot remove 'dmc.tar.part*': No such file or directory

I went through the code and the problem seems to lie in this line: ia download dmc_dataset_$i dmc.tar.part$i I guess the data is not correctly downloaded. Since I have no idea about what the dataset looks like or how the project is structured, I cannot figure out a way to download the dataset and upload to my server. I guess similar problems will show up if I continue to download Atari dataset as well as both the checkpoints.

Would you plz help me solve the problem or provide an alternative to get the data?

luccachiang avatar Jul 25 '23 05:07 luccachiang