text
text copied to clipboard
1. Ignore SentencePiece::BYTE during encoding instead of throwing error
- Ignore SentencePiece::BYTE during encoding instead of throwing error
- Early exit from DecodePrecompiledCharsmap when precompiled_charsmap is empty