Aestheval Warning and cannot download any submission files

trafficstars

When I'm trying to download dataset,

I got warning /opt/conda/lib/python3.7/site-packages/pmaw/Request.py:263: UserWarning: 2000 items were not found in Pushshift
warnings.warn(f"{self.limit} items were not found in Pushshift")

and cannot download any images :(

Downloading comments of 0 submission files
Getting images for:
[]

How can I solve this problem?

Jan 10 '23 08:01 Mer9ury

Same here. It would be better if the authors gave us a link to directly download the dataset (ex: from Google Drive) instead of making us scrape the dataset ourselves.

Jan 26 '23 20:01 MartinEthier

Hi! Sorry for the wait, it's true that it's far from convenient the way to download the data, we are looking for alternatives that also comply with Reddit terms of service. Let me look into the warning and why it's not downloading images and get back to you!

Jan 30 '23 07:01 dveni

Hi! Finally got some time to get into this, apparently Pushshift is migrating to a new infrastructure and all data before Novemeber is not yet available (see official thread). They are also updating the API, so there were some issues in pmaw. I've already updated pmaw, but we will have to wait until Pushshift is completely online again.

In the meantime, you can uncomment this line to scrape the latest post in the subreddit (although I still have to check whether the preprocessing scripts will need to be updated) or contact me by email.

I'll post updates in this issue :)

Feb 13 '23 13:02 dveni

hello，I have commented this line of code, but I still encounter the following problem. How can I solve this problem? 34CD587CAA9129D24751346F0B98C32B 91498F228512AB2302469C658BCF4537