Paweł Miech
Paweł Miech
Thank you for flagging these problems @tommorris I am a user of this package, so I'll try to help. re: > Decide whether to get rid of Python 2 support...
IMO it's nice to have all relevant request data in log message for retry. If there is some information available about request, why not show it to users? If someone...
are you sure you are starting scrapyrt service inside pod in a way that the service is listening on interface available from outside? We got -i argument as command line...
There are no new features planned, but looks like we may need to have a new release to keep project stable and running because of https://github.com/scrapinghub/scrapyrt/issues/148. I'm more than happy...
@runa can you add some sample code to reproduce this and add more details? I tested with this simple spider ```python import scrapy class ToScrapeCSSSpider(scrapy.Spider): name = "toscrape-css" start_urls =...
> Maybe we can handle this but I am a bit hesitant to get into trying to support trial tests I somehow assumed twisted trial tests are supported. Maybe some...
just replacing trial with pytest-twisted does the trick and works fine, so I could just remove all twisted trial and replace them with pytest_twisted.inlineCallbacks if you decide not to support...
one thing I noticed is that we exit using [os._exit(1)](https://github.com/scrapinghub/crawlera-tools/blob/master/crawlera-bench#L71) > os._exit(n) > Exit the process with status n, without calling cleanup handlers, flushing stdio buffers, etc. [docs](https://docs.python.org/2/library/os.html) I stumbled...
> Such a change on OffsiteMiddleware would be backwards incompatible if we provide it as downloader mdw, as those who patched it may have 2 competing mdw or a broken...