Mexican_Man
Results
1
issues of
Mexican_Man
I would like to know if there is any possibility to control the splitting of a word into tokens, besides setting up bpe dropout? For example: "Best" can be tokenized...
Mexican_Man
I would like to know if there is any possibility to control the splitting of a word into tokens, besides setting up bpe dropout? For example: "Best" can be tokenized...