how to run Javascript tag before extracting data from each page

[hamedf62]

hi and good day

as i need to extract comments from a page, as long texts are hided and need to push "read more" link at first, it done by javascript code.

so i need to run a scripts in each page before extracting data.

kindly advice how its possible...

warm regards

[omar-elmaria]

I am also facing the same issue. Mr. developer, your reply would be highly appreciated :))

[pixgarden]

BY default, I don't think rcrawler is the perfect tool to do that, I would recommend using selenium or puppeteer both can be used via an R package too.

It might be possible to get the data by looking at which URL is being called (inside the network panel of your browser) when you click on loadmore. It depends on how the website is built.