R Max Espinoza
R Max Espinoza
I got bitten by this bug. When redirect is enabled, the symptom is that the frontera gets the first seed request, receives the redirect, then adds the redirected URL as...
I'm also looking into this. We have a class that uses environment variables and we are not sure what section to use to document that.
Did you try the `dont_filter` request meta parameter?
Looks like you need a slightly different implementation. The dupefilter assumes a single crawl session and by default it uses the spider name as redis key prefix. But it seems...
Hi! Thanks for the contribution. Is it possible to add a test for this?
One issue is due this line https://github.com/scrapy/scrapy/blob/master/scrapy/contrib/pipeline/files.py#L196 when `file_key` call raises an exception here https://github.com/scrapy/scrapy/blob/master/scrapy/contrib/pipeline/files.py#L196