PULSE icon indicating copy to clipboard operation
PULSE copied to clipboard

Published 20 hours ago • verified publisher icon openmedlab

tokenizer是否是BloomTokenizerFast

Open MelodyChenjun opened this issue 1 year ago • 1 comments

在加载tokenizer的时候，报错autotokenizer没有BloomTokenizer，是否需要在tokenizer_config.json中修改成BloomTokenizerFast

MelodyChenjun avatar Sep 06 '23 03:09 MelodyChenjun