bert icon indicating copy to clipboard operation
bert copied to clipboard

Published 20 hours ago • verified publisher icon google-research

dose <s> represent whitespace in the chinese pretrained vocabulary?

Open lorashen opened this issue 6 years ago • 1 comments

Because the chinese pretrained vocab does not include all the english words, so I split english words into characters. Then how do I represent whitespace between english words?

lorashen avatar Jan 22 '19 09:01 lorashen

+1. and does <T> mean tab?

lan2720 avatar Dec 19 '19 11:12 lan2720