sudachi.rs
sudachi.rs copied to clipboard
WorksApplications
Sudachi in Rust 🦀 and new generation of SudachiPy
I try to build user dictionary using ubuild on sudachipy (>= 0.6.8). It hasn't provided any information in the error message for solving the problem. I replace my work directory...
ref: https://sudachi-dev.slack.com/archives/CBCF278AC/p1675047038560799 https://sudachi-dev.slack.com/archives/CBCF278AC/p1675061785400919
Some actions become deprecated. e.g. ``` actions/checkout@v3 actions/setup-python@v4 actions/cache@v3 actions/upload-artifact@v3 peaceiris/actions-gh-pages@v3 ``` ref: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20 https://github.com/WorksApplications/sudachi.rs/actions/runs/8058810554 https://github.com/WorksApplications/sudachi.rs/actions/runs/8058810553 https://github.com/WorksApplications/sudachi.rs/actions/runs/8058810544
partial fix for #40 (warnings from [Clippy](https://github.com/rust-lang/rust-clippy)). Fix clippy warnings (`cargo clippy --all-targets --all-features`) fixable with no breaking api changes. Rest of them (which need breaking changes) are fixed in...
partial fix for #40. Fix clippy warnings (rest of #263). Contains some breaking changes: - rm unused `BAKED_DICTIONARY_BYTES` - rm unused `SplitIter` - rename `StringNumber.to_string` -> `get_normalized` - change some...
A help describes that `-d` option "print the bebug information": ``` $ sudachipy tokenize -h usage: sudachipy tokenize [-h] [-r file] [-m {A,B,C}] [-o file] [-s string] [-a] [-d] [-v]...
Creating pre-tokenizer with surface-projection specified does not overrides the projection of dictionary. In test: https://github.com/WorksApplications/sudachi.rs/blob/232d9ee09e8397f5dfaa6f10c743cf09cf1d4f57/python/tests/test_pretokenizers.py#L105-L119 Is this intentional or bug?
Want to raise errors in more consistent manner. - Every errors raised should be an instance of `sudachipy.errors.SudachiError`. - Should use `errors` crate to create/wrap errors.
Metadata
Owner
Metadata
Sudachi in Rust 🦀 and new generation of SudachiPy