spotgen icon indicating copy to clipboard operation
spotgen copied to clipboard

Published 20 hours ago • verified publisher icon epsil

Awesome project! .. but the webcrawler (reddit) seems to not work anymore?

Open Moulde opened this issue 6 years ago • 2 comments

I tried running it locally, but it stops without any errors after 2 or so seconds. It seems like the web version does the same.

spotgen https://www.reddit.com/r/AskReddit/comments/43zdqe/what_is_your_favorite_song_with_no_words/

Moulde avatar May 31 '18 10:05 Moulde

Reddit went through a redesign as of recently, so the scraping code in scraper.js is unfortunately outdated.

I'm not sure how JavaScript-driven the new design is. It might be necessary to leverage a browser automation library like Nightmare.

epsil avatar Jul 05 '18 11:07 epsil

Could a temporary fix be to use old.reddit.com?

Moulde avatar Jul 10 '18 14:07 Moulde