scrapy_facebooker icon indicating copy to clipboard operation
scrapy_facebooker copied to clipboard

Add spiders that use Graph API to receive the datas

Open refeed opened this issue 8 years ago • 1 comments

Fetch the datas like the list of facebook posts, videos, events is hard with traditional scraping, since we fetch it from the ajax response of a facebook endpoint that we don't know how to use it, we just guessing it (it looks slightly hacky), and the common problem is it's sometimes work and sometimes doesn't.

For the next step we'll deprecate the traditional spiders, and use the official Graph API from Facebook instead.

refeed avatar Jul 29 '17 00:07 refeed

I think we still need to support the traditional scraper spiders, since it's kinda difficult to get an Graph API key (because we need to be a graph api dev)

refeed avatar Jul 30 '17 16:07 refeed