BertTokenizers icon indicating copy to clipboard operation
BertTokenizers copied to clipboard

Custom vocabulary classes naming error

Open tsepton opened this issue 1 year ago • 0 comments

Inside BertUncasedCustomVocabulary.cs, I would expect to see the declaration for a class extending UncasedTokenizer, however the class has the following signature public class BertCasedCustomVocabulary : CasedTokenizer.

Something similar happens inside BertCasedCustomVocabulary.cs, where the class signature is public class BertUnasedCustomVocabulary : CasedTokenizer

tsepton avatar Jun 20 '23 09:06 tsepton