WoBERT icon indicating copy to clipboard operation
WoBERT copied to clipboard

WoBERT Pytorch 版本,中文词汇级Bert:WoBERT学习

Results 2 WoBERT issues
Sort by recently updated
recently updated
newest added

你好,我看WoBertTokenizer中有self.unique_added_tokens_encoder,但没有定义,请问WoBertTokenizer是不是少定义了self.unique_added_tokens_encoder的定义,请问该如何定义呢?

你好,请问jieba.load_userdict(os.path.join(train_args.pretrained_weights_path, 'vocab.txt'))在tokenizer之前一定要加吗,我看这好像是jieba加载自定义词典的方法,jieba读取wobert的词表得用这种方式吗?