🔪 The Khan scrapers are broken 🔪

[jbampton]

Looks like all the khan scrapers are broken :(

[mirelagrigoras]

Hello @jbampton. Is this the script that we should fix: https://github.com/slurpcode/slurp/blob/master/scrapers/python/lxml/khan.py?

[jbampton]

Hi @mirelagrigoras !!

Yes that is the khan Python script that needs fixing.

But my Khan profile link is now -> https://www.khanacademy.org/profile/JohnBampton/

[jbampton]

I think the way the Khan pages are rendered has changed.

Seems they might be using dynamic JS to create the web pages.

[jbampton]

We need the Energy points earned data scraped.

[ajakov]

Yes, the way pages are rendered has changed. Whoever wants to fix other scrapers can check out the PHP scrapper, it works with the new layout and data fetching.

[jbampton]

Done in Python now

[wickedknock]

does it still needs fixing , really want to do some web scraping , if so please add me

[jbampton]

Yes they do need fixing