朱良俊

icon indicating a website link zlj63501.github.io

icon company Jiangnan University icon location Jiangsu, Wuxi icon location With dream as the horse, traveling across the stars

Results 1 issues of 朱良俊

What is the "token"?

Hello,this is my question. In "reader.py" ,the 14line ,tokenize = lambda x: [token.strip().lower() for token in re.split(SPLIT_RE, x) if token.strip()] , I am not search the "token". So what is...