scrapy-training icon indicating copy to clipboard operation
scrapy-training copied to clipboard

Published 20 hours ago • verified publisher icon scrapinghub

Reddit spider in unit 1 is no longer valid

Open imduffy15 opened this issue 5 years ago • 0 comments

Hi,

The spider supplied in unit 1 for scraping reddit.com no longer appears to be valid.

Their newer site looks to be using react styled components which generates CSS classnames, probably not wise to use them for ease of maintainability.

On the plus side, adding .json to the URLs gives a JSON document: https://www.reddit.com/r/programming.json

imduffy15 avatar May 04 '19 22:05 imduffy15