staticSearch icon indicating copy to clipboard operation
staticSearch copied to clipboard

Consider making the tokenization regex configurable

Open martindholmes opened this issue 9 months ago • 0 comments

Following the work on issue #300, it seems plausible that other situations will arise in which the default tokenization regex is not appropriate for a particular linguistic or historical context. We should consider allowing users to define their tokenization regex in the config file.

martindholmes avatar May 08 '24 19:05 martindholmes