scrapy-fake-useragent icon indicating copy to clipboard operation
scrapy-fake-useragent copied to clipboard

Published 20 hours ago • verified publisher icon alecxe

Add support for `RETRY_EXCEPTIONS` setting

Open Prometheus3375 opened this issue 2 years ago • 1 comments
trafficstars

Resolves #41.

I tested locally with Scrapy 2.9.0, 2.10.0 and 2.11.0. 2.10 is the version with exception upon accessing EXCEPTIONS_TO_RETRY. In 2.11 this error was fixed.

On all versions middleware does not fail when process_exception is called. On 2.10+ the middleware also respects setting RETRY_EXCEPTIONS.

I am not sure how to add tests with specific scrapy version.

Prometheus3375 avatar Sep 18 '23 18:09 Prometheus3375

@alecxe hello. Can you review this one and release a new version to PyPI?

Prometheus3375 avatar Sep 27 '23 12:09 Prometheus3375