fbcrawl icon indicating copy to clipboard operation
fbcrawl copied to clipboard

Ignoring response 404 - getting empty csv

Open andsic12 opened this issue 4 years ago • 1 comments

Hello, as per title, this is the error i receive, either when trying to scrape a page or comments:

[scrapy.spidermiddlewares.httperror] INFO: Ignoring response <404 https://mbasic.facebook.com/login/device-based/regular/login/partitodemocratico/posts/2296031677301785>: HTTP status code is not handled or not allowed

I tried changing user agent, removing devices sessions as I read among the similar issues, nothing worked. Thanks in advance

andsic12 avatar Nov 22 '20 16:11 andsic12

Duplicate of #2 A simple workaround is to log in via your traditional web browser once and everything should work fine.

ugonfor avatar Jan 19 '21 05:01 ugonfor