Mikhail Korobov

So the 1st issue is that CookiesMiddleware sets Cookie header even if cookiejar is empty, or, broadly speaking, that it discards Cookie header set on a request instead of adding...

@elacuesta yeah, I agree that using value set in `cookies` argument makes more sense in this case.

We may go further, and dump stats periodically (https://github.com/scrapy/scrapy/issues/2173). Enhancing this logstats line also sounds fine to me. What else can be useful? Some ideas: * time since crawl started;...

Hey @VMRuiz! > We could create some customs extensions like LogStats for each of the proposed stats. That way can enable and disabled different stats as needed. I think it...

> Having all the log in the same line would make impossible to turn off some loggers, unless we create some form of hyper-log which recover logs messages from all...

Do you have an idea what could ``` \xd3\xc9\xd3\xda\xc1\xac\xbd\xd3\xb7\xbd\xd4\xda\xd2 \xbb\xb6\xce\xca\xb1\xbc\xe4\xba\xf3\xc3\xbb\xd3\xd0\xd5\xfd\xc8\xb7\xb4\xf0\xb8 \xb4\xbb\xf2\xc1\xac\xbd\xd3\xb5\xc4\xd6\xf7\xbb\xfa\xc3\xbb\xd3\xd0\xb7\xb4\xd3 \xa6\xa3\xac\xc1\xac\xbd\xd3\xb3\xa2\xca\xd4\xca\xa7\xb0\xdc\xa1\xa3. ``` mean? Could you please also paste the output of the following script: ``` import sys, locale print(sys.getdefaultencoding(),...

Could you try setting [LOG_ENCODING](http://doc.scrapy.org/en/master/topics/settings.html#log-encoding) to cp936? This is far from ideal, but it could help. Printing these non-ascii messages looks useful; #1331 will make then unreadable, at least in...

@curita I think the reason it doesn't work for @movingheart is > when I run it in scripts, output: > ('ascii', None, 'cp936')

@curita I think exception messages should be ascii-only in Python 2.x; unicode is not really supported for exception messages in Python 2.x. If an error message is not ascii we...

What's the use case of setting Referrer through DEFAULT_REQUEST_HEADERS?