Fabio Del Rosso comments

Results 3 comments of


                                            Fabio Del Rosso

Consider auto-failing pages that have 5xx HTTP status code

Hello @jancurn, how about if we set an array of error codes to consider in the sessionPoolOptions? Like this: `sessionPoolOptions: { maxPoolSize: 100, errorStatusCode: [401, 403, 429, 500] // optional...

Can we have the support even for grazie_graziella_grazieastocazzo?

Hello! I have sent a Pull Request for this! https://github.com/dottorblaster/stocazzo/pull/40 Enjoy!

The request queue scans all 450k (99.999% of which are done towards the end) requests for each iteration

Same problem, after 12 hours of running (VPS 8GB RAM, 30GB SSD) - docker container with PlaywrightCrawler: $ find request_queues -type f | wc -l 36390 INFO PlaywrightCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcurrency":15,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":1,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}...