UER-py icon indicating copy to clipboard operation
UER-py copied to clipboard

请问user-py的 tokenizer是如何保存和转换的

Open ray075hl opened this issue 3 years ago • 0 comments

怎么保存成 transforms 能够直接加载的 文件; 例如: tokenizer = BertTokenizer.from_pretrained("uer/t5-small-chinese-cluecorpussmall")

ray075hl avatar Nov 08 '22 07:11 ray075hl