tantivy-py icon indicating copy to clipboard operation
tantivy-py copied to clipboard
verified publisher icon quickwit-oss

Investigate the plugin design in Polars

Open cjrh opened this issue 1 year ago • 0 comments

Polars has a plugin design that allows separate plugins to be installed and used at runtime.

  • https://github.com/pola-rs/pyo3-polars?tab=readme-ov-file#1-shared-library-plugins-for-polars
  • https://docs.pola.rs/user-guide/expressions/plugins/

image

Perhaps we can mimic their design and allow additional tokenizers to be installed separately. For example #200.

cjrh avatar Sep 25 '24 11:09 cjrh