fbcrawl
fbcrawl copied to clipboard
rugantio
A Facebook crawler
Hello guys, I receive this error (before everything works nice): **ValueError: No element found with //form[contains(@action, "login")]** Can you help me ?
When trying to login I receive: `2021-07-07 13:48:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2021-07-07 13:48:42 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/home/adam/venvs/sandbox/lib/python3.8/site-packages/twisted/internet/defer.py",...
INFO: Going through the "save-device" checkpoint 2020-10-14 18:15:57 [fb] INFO: Scraping facebook page https://mbasic.facebook.com/DonaldTrump 2020-10-14 18:16:00 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://mbasic.facebook.com/?_rdr) Traceback (most recent call last): File "/home/aditya/.local/lib/python3.6/site-packages/twisted/internet/defer.py",...
Hi, I noticed that the comments crawler is always unable to parse comments from posts (specifically a single post from a group, when crawler is launched with the post attribute)....
Hello, as per title, this is the error i receive, either when trying to scrape a page or comments: [scrapy.spidermiddlewares.httperror] INFO: Ignoring response : HTTP status code is not handled...
Mbasic.facebook's "Show More" does not show more posts. As a result the fbcrawl outputs the same, most recent, posts over and over.
when I trying to crawling my site, it occurs error: ``` File ".\comments.py", line 63, in parse_page temp_post = response.urljoin(post[0]) IndexError: list index out of range ``` the above line...
Hello, when running scrapy using default arguments, I am prompted with an Indentation Error, scrapy outputs the task is completed, and I'm left with a blank csv file. Does anyone...
Hi there, When I test the command like: ``` scrapy crawl fb -a email="" -a password="" \ -a page=https://mbasic.facebook.com/story.php?story_fbid=10165072531765725&id=153080620724 \ -a lang=en -o Trump.csv ``` I get error like: ```...
Sorry for this issue, I've tried Google it but still can't find a solution. when I try follow command scrapy crawl fb -a email="[email protected]" -a password="____________" -a page="DonaldTrump" -a date="2018-01-01"...
