Scrapegraph-ai icon indicating copy to clipboard operation
Scrapegraph-ai copied to clipboard

Add dynamic js support

Open lrdoflnlss opened this issue 7 months ago • 1 comments

the current version does not have the ability to scrape such sites with dynamically loaded content

https://www.freeletics.com/

https://sider.ai/en

lrdoflnlss avatar Apr 14 '25 17:04 lrdoflnlss

@lrdoflnlss did you find any alternatives to scrape dynamic loaded or paginated content?

SemyenPukhov avatar May 05 '25 20:05 SemyenPukhov

Hi, @lrdoflnlss. I'm Dosu, and I'm helping the Scrapegraph-ai team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You requested support for scraping dynamically loaded website content, mentioning freeletics.com and sider.ai as examples.
  • Currently, Scrapegraph-ai does not support scraping dynamic or paginated content.
  • The maintainer asked if you had found any alternative methods for handling this type of content.
  • There have been no further updates or solutions provided since then.

What's Next:

  • Please let me know if this issue is still relevant with the latest version of Scrapegraph-ai by commenting here to keep the discussion open.
  • Otherwise, this issue will be automatically closed in 7 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Aug 04 '25 16:08 dosubot[bot]