Parse descriptions from HTML commented out
Crawler does not download event descriptions...
You may only need one xpath correction in https://github.com/DaWe35/Facebook-event-crawler/blob/cac0845468352423c061d943fbf334ed2651eb73/Crawlr.py#L260
I know, but what is correct ?
Im testing with new selector but still does not effects...
event_description = tree.xpath('//div[@id="unit_id_886302548152152"]/section[1]/text()')
Have you got any idea?
section[1]
That's weird, section[1] need to work. Anyway, I think there is a Facebook release slipping - in my old facebook account <div> works, in my new account <section>, so we need to support all of them. Cool....
Can you try out event_description = tree.xpath('//div[@id="unit_id_886302548152152"]/section/text()') ? Anyway I don't understand why section[1] not works...
Descriptions in mysql are still empty :(
Have you got any idea and solution... ?
Have you got any idea and solution... ?
Sorry @elvispoz, today I have no time, I'll check it out later. Sometimes I need to work for money also :)
@elvispoz I just registered a new Facebook account, and everything works fine. Can you give me your Facebook account to have a try? If you followed my guide, you registered one only for FB crawler, so there is no personal data. You can find me here: https://discord.gg/69SZC4v (I'm DaWe)
Hi,
Have you got any time for this? I see thet fb make some change in code and put description to:
<!-- xxx -->
Maybe it will be some solution... https://stackoverflow.com/questions/44506990/getting-encoded-text-while-scraping-the-data-from-url-using-beautifulsoup-python
Is there anyone having the same issue?
Is there anyone having the same issue?
Hello, I followed all your guidances, and the crawler worked smoothly. But there are no records downloaded, the 'events' table is always empty... I am not sure which part went wrong...
Same here, the crawler is working, but 'events" table still empty...
python3 Crawlr.py
Logging in to facebook...
0 old row deleted
Pages are already updated less than an hour ago, no new events queried