colly icon indicating copy to clipboard operation
colly copied to clipboard

Published 20 hours ago • verified publisher icon gocolly

How to crawl a single page of vue or react?

Open b1lz9 opened this issue 2 years ago • 2 comments

b1lz9 avatar Feb 02 '23 03:02 b1lz9

I believe colly can not do such thing. maybe try https://github.com/chromedp/chromedp

axiangcoding avatar Mar 22 '23 00:03 axiangcoding

Colly is an excellent web scraping library for Golang, but it's important to note that it does not execute JavaScript. So, to crawl a Vue or ReactJS page effectively, you need to use a headless browser that can handle JavaScript rendering. Puppeteer is a popular headless browser used with Node.js, but you can also use a Golang wrapper for Puppeteer like chromedp

MTariq99 avatar Jul 24 '23 08:07 MTariq99