machinelearning icon indicating copy to clipboard operation
machinelearning copied to clipboard

Published 20 hours ago • verified publisher icon dotnet

xlm-Roberta tokenizer

Open ilaykid opened this issue 3 years ago • 1 comments

hey, can you add support to xlm-Roberta tokenizer? it's a very useful tokenizer that could be very helpful. thank you!

ilaykid avatar Nov 30 '22 14:11 ilaykid