rust-tinysegmenter icon indicating copy to clipboard operation
rust-tinysegmenter copied to clipboard
verified publisher icon woxtu

Expose tokens offsets

Open fulmicoton opened this issue 8 years ago • 0 comments

I am trying to integrate tinysegmenter with tantivy Would it be possible to expose a more advanced API ?

For instance expose the offset of the tokens (expressed in bytes)?

fulmicoton avatar Jun 09 '17 00:06 fulmicoton