huggingface-tokenizer-in-cxx icon indicating copy to clipboard operation
huggingface-tokenizer-in-cxx copied to clipboard

Published 20 hours ago • verified publisher icon wangkuiyi

Hello, does your project support decoder for byte-level-bpe?

Open Alex-Songs opened this issue 2 years ago • 0 comments
trafficstars

Hello, does your project support decoder for byte-level-bpe?

Alex-Songs avatar Apr 24 '23 07:04 Alex-Songs