BertTokenizers
BertTokenizers copied to clipboard
Custom vocabulary classes naming error
Inside BertUncasedCustomVocabulary.cs
, I would expect to see the declaration for a class extending UncasedTokenizer
, however the class has the following signature public class BertCasedCustomVocabulary : CasedTokenizer
.
Something similar happens inside BertCasedCustomVocabulary.cs
, where the class signature is public class BertUnasedCustomVocabulary : CasedTokenizer