Tokenizer tokenizer = ...;

[stenpiren]

What goes in "..." for Tokenizer in the example you wrote in README.md? I would like to replicate the example but I am confused there. Thanks.

[marevol]

You can use Tokenizer implementations for Lucene. For more details, please see Lucene's documents.