search-text-tokenizer icon indicating copy to clipboard operation
search-text-tokenizer copied to clipboard

Tokenize search keyword text in the same way as Google does.

Results 2 search-text-tokenizer issues
Sort by recently updated
recently updated
newest added

Google seems to avoid this problem somehow. ```js console.log(tokenizer("'don't stop believing'")); /* * [ * { * "phrase": true * "term": "don" * }, * { * "term": "t" *...

Add support for OR searches. Should support OR or | (maybe || too). Perhaps a nested array could indicate alternatives?