FacebookPostsScraper
FacebookPostsScraper copied to clipboard
hhsm95
Increase number of scraped posts
Hi,
Right now when I scrape, only 7 posts are returned. I was wondering if there is a way to increase the number of posts scraped
there is no any way to collect more posts or even i have ability to control on number of posts i get bcs this scripts is meaningless without this param
hi Hugo, Is there a way to add an Infinite Scroll function? I have done an infinite scroll using nodejs but I am not sure how to do it with Python. I have the same issue - I can only scrape 5 posts. I would like to scrape more. So far, it works well - thank you for a great tutorial! Muchas gracias.
-A
we may need to use browser.get; with nodejs we use document.body.scrollHeight. How is this function written with Python?
Okey, let's talk about this functionality. This code only gets the last 5 posts of the profile because they are the ones that appear on the timeline, this in many cases is enough if you only want to monitor a profile. Previously, I have extracted older posts, but because I use a User Agent from an older mobile phone, Facebook limits the amount of historical posts that can be viewed in this kind of User Agent, so you cannot extract all posts from a profile. My code doesn't use Javascript to render profiles, it is very basic only to monitor profiles. In the next few days, when I have some time, I will apply a change to extract all the posts that the mobile version of Facebook allows my User Agent. Thank you all for the comments.
Hi I do a research project where I need to extract several thousand posts from a group. I have tried the Ultimate Facebook Scraper which works, but only for around 1700 posts due to javascripts slowing down the search (probably). Your output is really neat so I would be very happy if it was possible to use this script.
is this still in the plan? to be implemented? this will be really useful for me too!
