Hustcw

icon indicating a website link https://netsec.ccert.edu.cn/people/wanghao icon indicating an email [email protected]

icon company VUL337-NISL@THU icon location Beijing, Tsinghua University icon location A Ph.D student at Tsinghua University

Results 2 comments of Hustcw

Exception upon attempting to load a Tokenizer from file

any update to this problem? I've had the same issue

Exception upon attempting to load a Tokenizer from file

> Have you tried the solution proposed by @lukas-blecher to use a pre-tokenizer? > > I believe this issue is related to this one: #645 Yes, I've used a pre-tokenizer....