aio-scrapy icon indicating copy to clipboard operation
aio-scrapy copied to clipboard

process_exception 未起作用

Open shuaiqileilei opened this issue 1 year ago • 1 comments

下载中间键的process_response()函数,代码异常或者主动抛出的IgnoreRequest ,在后续的中间键的process_exception()并不能捕获到

shuaiqileilei avatar Apr 06 '23 07:04 shuaiqileilei

scrapy在下载中间键的process_response中的异常,也是不会走process_exception的吧, process_response中的异常要自己处理,要么IgnoreRequest 要么retry

ConlinH avatar May 04 '23 09:05 ConlinH