Mexican_Man

Results 1 issues of Mexican_Man

I would like to know if there is any possibility to control the splitting of a word into tokens, besides setting up bpe dropout? For example: "Best" can be tokenized...