bert-Chinese-classification-task icon indicating copy to clipboard operation
bert-Chinese-classification-task copied to clipboard

Published 20 hours ago • verified publisher icon NLPScott

汉语中有做分词吗？还是直接在字级别做了

Open MrCuri0sity opened this issue 6 years ago • 2 comments
trafficstars

MrCuri0sity avatar Dec 19 '18 09:12 MrCuri0sity

这个不做分词，投入预训练transformer后，会进行切词，切词的依据是谷歌bert提供的词表

NLPScott avatar Dec 20 '18 11:12 NLPScott

汉语预训练模型作者是在字级别做的，不是词级别。

JepsonWong avatar Dec 27 '18 18:12 JepsonWong