Refactor/clean up `handle_httpstatus_list`/`HTTPERROR_ALLOWED_CODES` etc.

Open wRAR opened this issue 3 weeks ago • 1 comments

There are several related things used by HttpErrorMiddleware and RedirectMiddleware (handle_httpstatus_list spider attr and meta key, handle_httpstatus_all meta key, HTTPERROR_ALLOWED_CODES and HTTPERROR_ALLOW_ALL settings), it would be nice to unify these, deprecate the spider attr, and make the resulting tunables more clear.

See the discussion/ideas at https://github.com/scrapy/scrapy/pull/7039#discussion_r2317735734 (not sure why does it mention a handle_httpstatus_all spider attr, I don't think it exists)

Dec 01 '25 16:12 wRAR

Let me know what you think

Please don't spam coding aggent suggestions.

Dec 05 '25 07:12 wRAR