moranbel
Results
1
comments of
moranbel
use `WordLevel` as Tokenizer. see here- https://huggingface.co/docs/tokenizers/python/latest/components.html