recsys_slates_dataset icon indicating copy to clipboard operation
recsys_slates_dataset copied to clipboard

torch dataloader doesn't work

Open YasBenAll opened this issue 1 year ago • 1 comments
trafficstars

I'm running the following code:

import torch
from recsys_slates_dataset import dataset_torch
ind2val, itemattr, dataloaders = dataset_torch.load_dataloaders(data_dir="dat")

print("Dictionary containing the dataloaders:")
print(dataloaders)

I get the following output:

2024-02-22 15:21:25,820 Download data if not in data folder..
2024-02-22 15:21:25,820 Downloading data.npz

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1XHqyk01qi9qnvBTfWWwqgDzrdjv1eBVV 

2024-02-22 15:21:26,080 Downloading ind2val.json
Access denied with the following error:
Access denied with the following error:

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1WOCKfuttMacCb84yQYcRjxjEtgPp6F4N 

2024-02-22 15:21:26,277 Downloading itemattr.npz

 	Cannot retrieve the public link of the file. You may need to change
	the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1rKKyMQZqWp8vQ-Pl1SeHrQxzc5dXldnR 

2024-02-22 15:21:26,492 Done downloading all files.
2024-02-22 15:21:26,493 Load data..

What happened to these google drive links and why are they not publicly available anymore?

YasBenAll avatar Feb 22 '24 14:02 YasBenAll

Dear YasBen, thank you for bringing this to my attention. I did an initial investigation and right now Im not sure. But you can also find the files as git lfs files here:

https://github.com/finn-no/recsys_slates_dataset/tree/main/data

If you download them from there you should be able to run the remaining functions. I added the google drive destinations so it would be easier, but I guess they have broken by now. I will look into it, but I hope you have a workaround until then.

Best regards, Simen

On Thu, 22 Feb 2024, 15:25 YasBenAll, @.***> wrote:

I'm running the following code:

import torch from recsys_slates_dataset import dataset_torch ind2val, itemattr, dataloaders = dataset_torch.load_dataloaders(data_dir="dat")

print("Dictionary containing the dataloaders:") print(dataloaders)

I get the following output:

2024-02-22 15:21:25,820 Download data if not in data folder.. 2024-02-22 15:21:25,820 Downloading data.npz

Cannot retrieve the public link of the file. You may need to change the permission to 'Anyone with the link', or have had many accesses.

You may still be able to access the file from the browser:

https://drive.google.com/uc?id=1XHqyk01qi9qnvBTfWWwqgDzrdjv1eBVV

2024-02-22 15:21:26,080 Downloading ind2val.json Access denied with the following error: Access denied with the following error:

Cannot retrieve the public link of the file. You may need to change the permission to 'Anyone with the link', or have had many accesses.

You may still be able to access the file from the browser:

https://drive.google.com/uc?id=1WOCKfuttMacCb84yQYcRjxjEtgPp6F4N

2024-02-22 15:21:26,277 Downloading itemattr.npz

Cannot retrieve the public link of the file. You may need to change the permission to 'Anyone with the link', or have had many accesses.

You may still be able to access the file from the browser:

https://drive.google.com/uc?id=1rKKyMQZqWp8vQ-Pl1SeHrQxzc5dXldnR

2024-02-22 15:21:26,492 Done downloading all files. 2024-02-22 15:21:26,493 Load data..

What happened to these google drive links and why are they not publicly available anymore?

— Reply to this email directly, view it on GitHub https://github.com/finn-no/recsys_slates_dataset/issues/27, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABWOGTGC4CUHGSAJJCLVL3DYU5INVAVCNFSM6AAAAABDVBQDL6VHI2DSMVQWIX3LMV43ASLTON2WKOZSGE2DSMJZGUYDONI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

simeneide avatar Feb 23 '24 08:02 simeneide