LWF icon indicating copy to clipboard operation
LWF copied to clipboard

RuntimeError: Dataset metadata file not found or corrupted. You can use download=True to download it

Open niranjansuthar70 opened this issue 4 years ago • 10 comments

Hello, @ngailapdi, I am trying to reproduce the results, when I am executing the main.py its showing following errors after downloading data.

"RuntimeError: Dataset metadata file not found or corrupted. You can use download=True to download it"

niranjansuthar70 avatar Feb 17 '21 10:02 niranjansuthar70

same error here.

UsmanTahirKiani avatar Mar 03 '21 13:03 UsmanTahirKiani

Hi, please make sure you use the correct version of PyTorch. PyTorch version up to 1.0 should not encounter this issue. Alternatively, you can modify the dataset file (following PyTorch dataset/dataloader documents) to be able to run with higher PyTorch versions.

ngailapdi avatar Mar 04 '21 15:03 ngailapdi

Hello @ngailapdi thank you for your response, I have checked my configurations.

pytorch =0.4.1 torchvision= 0.2.2 python = 3.6.6 os=win10

I am still getting the same error as mentioned above.

niranjansuthar70 avatar Mar 05 '21 03:03 niranjansuthar70

Hello @UsmanTahirKiani , did you find the solution for that? I have tried with require version too.

niranjansuthar70 avatar Mar 09 '21 10:03 niranjansuthar70

Hi @niranjansuthar70 I updated the data loader file. Hopefully, it works now. Please let me know if it works for you.

ngailapdi avatar Mar 11 '21 06:03 ngailapdi

Hello @ngailapdi thanks for the reply, I have tired to run with updated files and this time there is no error. But my system got hanged. Config: GTX 1070 8GB, 32 GB RAM, i5 CPU.

I have also tried with batch size =1 but still same hanging issues. I had just uncomment this portion in main.py and run the script using python main.py

all_train = cifar100(root='./data',
                 train=True,
                 classes=range(100),
                 download=True,
                 transform=None)

mean_image = all_train.mean_image

Can you provide some insights on how much GPU memory, RAM and which GPU will be sufficient to run this project.? or I am missing some modifications in script?

niranjansuthar70 avatar Mar 11 '21 06:03 niranjansuthar70

This part is to compute the mean image. It usually will take a while but not too long.

ngailapdi avatar Mar 23 '21 17:03 ngailapdi

Hi @niranjansuthar70, just to make sure everything works for you. Can we close this issue now if there is no further concern?

ngailapdi avatar Apr 14 '21 13:04 ngailapdi

Hello @ngailapdi I didn't try it again because I am not sure about how much GPU memory does it require. Can you please confirm the GPU memory or which card you have used and RAM also.

Thanks

niranjansuthar70 avatar Apr 15 '21 12:04 niranjansuthar70

same error here,maybe you could provide this.npy file?

shixingy avatar Jan 02 '23 08:01 shixingy