[Feature]: tantivy tokenizer binding

[longjiquan]

Is there an existing issue for this?

• [X] I have searched the existing issues

Is your feature request related to a problem? Please describe.

This is one of fundamental utility for BM25 support.

Describe the solution you'd like.

I want to add binding for the tantivy tokenizer.

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response