rust-punkt icon indicating copy to clipboard operation
rust-punkt copied to clipboard

Training data should come as separate libraries

Open ferristseng opened this issue 7 years ago • 1 comments

Right now, the training data all comes as a single package. It might be better to include it as compiled code that is generated from a JSON document.

ferristseng avatar Jan 29 '18 03:01 ferristseng

Or perhaps include the zipped json-strings because the binary gets huge when using the punkt crate. A quick check with cmdline zip promises a reduction to 30% of the original size.

hirschenberger avatar Jan 29 '18 07:01 hirschenberger