David Smiley

+1 to the code you have here.

There's some info here: http://signaldump.org/solr/qpod/33137/applying-gzip-compression-in-solr-5-1

What I'm not sure about is the rule/pattern part as described here https://lucidworks.com/blog/2015/11/19/query-autofiltering-chapter-4-a-novel-approach-to-natural-language-processing/ -- need to think about that more. Any way, it's not essential.

Hi Amit; glad you have found this useful. I think your requirement could be implemented easily by modifying ConcatenateFilter to have a new mode perhaps called "prefixShingles" in which on...

Hi Amit, RE (1) sort: I'm unclear what you want to achieve. First of all, sorting _of what_? The tags, or the matching Solr documents? The matching solr documents are...

I understand how the document order is what it is, but I'm less clear on how it is you're getting 100s of matching documents per tag. Are you not using...

Ok. Perhaps what's needed is some sort of way to limit the number of tags at a specific location -- not for the sentence but for a given word. And...

Yeah; doesn't sound too hard, and it sounds generally useful.

Sorry but I simply have no time for this. If it were a trivial feature then I probably would have fit it in one of these evenings, but it's not....

Well you might start by looking at Solr FieldType.getSortField and checking out the API from there.