Sajid Shaikh

Results 84 comments of Sajid Shaikh

Thanks for informing about that "Accept all cookies" modal. Downloading image seems like a good idea but sending http request simultaneously while crawling might get us blocked quickly as well

Thanks, @vadimkantorov for the fabulous ideas. I will implement them eventually, it may take some time, but it seems like a great idea.

Okay, I will check this. Thanks!

Do you mind sharing that code snippet which you tried?

There was an issue that a few selectors were outdated and the crawler was throwing an error that no posts were found. But there wasn't any issue found regarding the...

I don't find any issue with that as the library is doing what it intends to. I don't know what you're trying, what kind of environment you're trying in. I've...

You may check the line of code which changes the page name argument of the scraper. Because If the library works for any page apart from just Meta AI, that's...

Your above code just stores the output into the `json_data` variable, you're not even printing that variable's content than how come your code is saving the data?, You can't even...

Yeah, that's expected. Because this method write output in write mode, which erases the previous content of the file. If you write two output in same file, you will get...

You can take reference from [this](https://github.com/shaikhsajid1111/facebook_page_scraper/blob/e77626e9676afdcb141f6c904bd6e302fe6e5afe/facebook_page_scraper/scraper.py#L113) method, just skip the row header part, and open file in append mode instead of write mode. Apology I couldn't provide you the code...