puppeteer-cluster icon indicating copy to clipboard operation
puppeteer-cluster copied to clipboard

Published 20 hours ago • verified publisher icon thomasdondorf

[ASK] Good sources about advanced scraping?

Open mxcdh opened this issue 2 years ago • 0 comments

Hello I build many scraping based on node + puppeteer + PostgreSQL as data storage and queue.

Everything works great, but I want to develop myself, my next goal to scraping data from + 100 000 000 pages (I have my proxy server with squid). When I can find sources to learn advanced scraping data, optimize performance, etc?

What would you recommend to me?

mxcdh avatar Apr 26 '22 11:04 mxcdh