scrapy-pyppeteer

scrapy-pyppeteer copied to clipboard

Retrying request download causes new pages to be opened

1

Hi, thanks for the useful project. I have a middleware that retries a request up to X times, each time using a new proxy. This means _download_request is called X...

nichoi

How to control concurrency?

1

demand:10W web pages rendered into Base64 upload OSS one day

luzihang123