Paul Tremberth
Paul Tremberth
Hey @markbaas , are you still interested in this issue? (I know, it's been quiet for 18 months...) You can check @eliasdorneles 's https://github.com/scrapy/parsel/pull/54 and maybe help it get merged...
ftr, this still fails with Twisted 16.4
It would be great if someone can resurrect this WIP #1559
@IAlwaysBeCoding , > didn't really like it and I believe it only caches Http requests which is kinda useless now a days. what didn't you like about it? I'm not...
Related: https://github.com/scrapy/scrapy/issues/2241
I do believe it's a bug.
@darshanime , thanks for looking into it! I've never seen HTTP 201 responses myself so I'm not sure how this all works. But if the response headers have a `Location`,...
Hey @kurkop , I'm resuming this one. Do you happen to have another website doing this HTTP 201? http://www.carroya.com seems to be returning HTTP 200 on images now.
Interesting @lolobosse . Have you encountered this often? If it's widespread then it could make sense. Otherwise, it could be sufficient to document this and recommend overriding this (private) `_get_sitemap_body`...
@sibiryakov , what do you mean by "batch operations on URL parsing"?