tokenizers
tokenizers copied to clipboard
Add wasm32 emscripten target support for python binding
Some changes to make it build with maturin for emscripten target.
RUSTUP_TOOLCHAIN=nightly maturin build --release -o dist --target wasm32-unknown-emscripten -i python3.10 --no-default-features --features unstable_wasm
Currently requires maturin git version and nightly Rust.
#1010
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.