Mikhail Korobov

Hey @sagnik, I'm not sure if this answers your question, but here is some code to get CRFsuite state and transition probabilities as numpy/scipy matrices: https://github.com/TeamHG-Memex/eli5/blob/417358f0ece0587fa18e9926756b7a9842776b72/eli5/sklearn_crfsuite/explain_weights.py#L68

Hey @sagnik! `eli5.show_weights` requires IPython to be installed - do you have it? It only makes sense to use eli5.show_weights in an IPython notebook; in a script it is better...

luikore's fork has some nice features, but when I last checked it I didn't like the API: instead of being based on callbacks it should have been based on iterator...

I'm not a C expert either, and I'm not an author of this repo - let's wait for @dcjones :)

See also: #10

It makes sense to me, +1. Likely the header is changed/deleted to signal that response body is decoded; we should provide another way to do that (add a flag to...

> Are all of those settings safe to enable for all broad crawls? I'm not 100% sure. It seems we should review them. Also, we should ensure that the users...

I haven't checked all your points yet, but a quick note: ISP's dns servers often can't handle the load if you're doing many dns requests, they may return errors. It...

As [documented](https://doc.scrapy.org/en/latest/topics/exceptions.html#scrapy.exceptions.CloseSpider), CloseSpider only works in spider callbacks, so this is not a bug: > This exception can be raised from a spider callback to request the spider to be...

Supporting CloseSpider in middlewares and extensions sounds reasonable; pull requests are welcome.