skrape.it icon indicating copy to clipboard operation
skrape.it copied to clipboard

Published 20 hours ago • verified publisher icon skrapeit

[QUESTION] Tell SkrapeIT to wait until each JavaScript loaded completely

Open ablx opened this issue 2 years ago • 3 comments

describe what you want to archive I want to scrape a website where some content is generated after loading via Javascript (SPA). However, SkrapeIT returns to fast, so that the content is missing. Instead, there is only a span with "Loading ..." which would be replaced later.

Is there anyway to tell SkrapeIT to either wait a given time or wait until an element is present before it returns? Other than that, great lib! Thanks!

ablx avatar Jan 13 '23 14:01 ablx

@ablx Were you able to find a solution for this ? I have a problem which requires this exact solution

@skrapeit @christian-draeger Team can you please check on this question

UKMIITB avatar Mar 11 '23 14:03 UKMIITB

@UKMIITB no

ablx avatar Mar 16 '23 08:03 ablx

@ablx @UKMIITB Not sure if it's the case, but have you tried this approach?
https://docs.skrape.it/docs/dsl/extract-client-side-rendered-data

ferreiravinicius avatar May 09 '23 12:05 ferreiravinicius