api icon indicating copy to clipboard operation
api copied to clipboard

API. Search. Submissions older than November 3, 2022 are not available (search by Subreddits)

Open smirnovstr-paul opened this issue 2 years ago • 10 comments

API. Search. Submissions older than November 3, 2022 are not available (search by Subreddits)

https://api.pushshift.io/reddit/search/submission/?metadata=true&size=500&subreddit=binance&before=1667505777

image

https://api.pushshift.io/reddit/search/submission/?metadata=true&size=500&subreddit=binance&before=1667505780

image

Sorting by creation date does not work. Not looking for submissions (on all subreddits) older than November 3, 2022.

smirnovstr-paul avatar Jan 09 '23 08:01 smirnovstr-paul

yes even older user submissions don't load anymore

abhranil26 avatar Jan 10 '23 17:01 abhranil26

Same for me 😭. Also, the API is only available as http where it used to be https.

If there is anything to do where I can help, I would be happy to contribute.

datanizing avatar Jan 11 '23 10:01 datanizing

Do you know how to fix it? or Any API to get historical reddit?

jannat5134 avatar Jan 13 '23 11:01 jannat5134

Any word on when this will be resolved?

Temporary Solution here https://www.reddit.com/r/pushshift/comments/107pm28/does_anybody_have_reddit_web_scraping_alternatives/

RaedShabbir avatar Jan 13 '23 21:01 RaedShabbir

Same for me! Can someone please take a look at this issue? It works fine for comments.

ranbix666 avatar Jan 17 '23 03:01 ranbix666

Is there any news on this problem? Also, does the Reddit API allows devs to extract the oldest posts from a subreddit?

JacobGeoGeek avatar Jan 27 '23 02:01 JacobGeoGeek

I'm afraid this problem is still active, any news on it? Does anybody know what causes it and is anybody working on it?

rbjakab avatar Feb 06 '23 20:02 rbjakab

https://www.reddit.com/r/pushshift/comments/zkggt0/update_on_colo_switchover_bug_fixes_reindexing/

Caused by server switch-over. I'd advise you to follow the instructions here for a temporary workaround.

Copied below for anybody else that comes across this issue.

Link to Reddit Archives Torrent Link to extraction code for multi-processing:

RaedShabbir avatar Feb 07 '23 01:02 RaedShabbir

@RaedShabbir thanks, but for me it won't work out since I don't have 2TB spare space on my laptop.

rbjakab avatar Feb 07 '23 09:02 rbjakab

I also encountered the same problem when operating on Apidog.

Liamhhhhh avatar Apr 08 '24 08:04 Liamhhhhh