curiousier-george
curiousier-george
Oh, in other words it first tries /posts/###, fails, and then tries /###? Is there a way I can avoid the first failure (and hence extra request)? I now know...
Wow, that cuts down my requests by almost half. Thanks! (Do you happen to have any idea whether this kind of reduction in requests matters to Facebook with respect to...
> You can use `enable_logging()` to see what requests are being made and when Thanks, I should have realized that but didn't! 😊
Hmm, no, that didn't work for me. What's really weird, though, is that I had made the changes in #707 in my own copy of facebook_scraper, and that _did_ work...
I apologize for my ignorance, but will `pip install git+https://github.com/kevinzg/facebook-scraper.git` install that commit?
Yes, works great! Thank you!
A little more info: I'm getting the exception while consuming the iterator returned by `get_posts()` in code like this: ```python posts = get_posts(username, options={'allow_extra_requests': False}) for post in posts: ......
My impression is that Facebook is becoming stricter. Maybe they are specifically checking for facebook-scraper? I wonder what others' experiences are ...
I wonder whether it's possible Facebook is randomly responding with this error as a kind of Turing test. If there is a relatively immediate response, Facebook assumes human - if...
Thanks, @Enuratique, for such a detailed reply! That's very helpful. Although I am aware of the possible issues generally, I don't have any experience writing custom scrapers until now. To...