puppeteer-cluster
puppeteer-cluster copied to clipboard
some wonders about maxConcurrency
eg,i set maxConcurrency: 20
1、i wonder what maxConcurrency mean?,it mean 20 chromes?or 20 chrome tabs? 2、i parallel request ,like 100 request,but i get error,so how to fix it~
{ Error: Protocol error (Network.getResponseBody): No resource with given identifier found
at Promise (/home/work/nodejs/node_modules/puppeteer/lib/Connection.js:183:56)
at new Promise (
@gxlfc maxConcurrency means the maximum number of parallel workers executing at any given time, for example if you ser maxConcurrency to 20 but you only have 3 tasks queued, it will open 3 browsers, but if you have 100 tasks queued, it will open 20 and as. soon as 1 or more of them is finished, it will open another browser until all 100 tasks are complete.