Georgiy Zatserklianyi

@djay > I'm not 100% sure but I don't think this test shows that the active size didn't increase while images were being downloaded, (ie before the deferred is released)....

@Gallaecio From my understanding source of `twisted.web._newclient.ResponseFailed: []` error on call of `line, self._buffer = self._buffer.split(self.delimiter, 1)` from this lines from [twisted/source](https://github.com/twisted/twisted/blob/525da4a0becad1e814c74f12c365f15fe9cd10de/src/twisted/protocols/basic.py#L536-L550 ) ```python try: line, self._buffer = self._buffer.split(self.delimiter, 1)...

It looks like pull request https://github.com/rmax/scrapy-redis/pull/286 that fix this already exist from Aug. This can be easily applied for app with current `scrapy-redis` version by.. overriding `schedule_next_request` method. ```python class...

I am not able to reproduce this locally on plain scrapy v.2.11.0 script.py ```python import scrapy from scrapy.crawler import CrawlerProcess as Cp class SitemapTestSpider(scrapy.spiders.sitemap.SitemapSpider): name = "quotes" custom_settings = {"DOWNLOAD_DELAY":...

> When a certain closing condition is met, requests which are currently in the downloader queue (up to [CONCURRENT_REQUESTS](https://docs.scrapy.org/en/2.11/topics/settings.html#std-setting-CONCURRENT_REQUESTS) requests) **are still processed**. This behaviour documented on [docs](https://docs.scrapy.org/en/2.11/topics/extensions.html#module-scrapy.extensions.closespider) as expected....

@leeprevost > Did this go anywhere? I’m struggling with an issue where my spider crawls links from a link extractor that denies PDFs. But some links are redirected to a...

Removing `slot.delay = 0` from middleware `process_request` https://github.com/scrapy-plugins/scrapy-zyte-api/blob/83df147098622ff96b60bd2b0921371fb469dfaf/scrapy_zyte_api/_downloader_middleware.py#L15-L25 From one side - will make possible to set delay. From other side it will not completely solve this issue because of...