Jay Lu

Results 2 issues of Jay Lu

RuntimeError: The size of tensor a (39) must match the size of tensor b (34) at non-singleton dimension 1 全是中文时,能正常分词 ![image](https://github.com/fastnlp/fastHan/assets/22993056/f4e0138d-edff-43a6-9a1f-621d5ede61b6) 句子中加入英文单词后就报错 ![image](https://github.com/fastnlp/fastHan/assets/22993056/dad0913b-c394-4354-b76e-1974c5b536ff) use_dict改成False后也能正常分词 ![image](https://github.com/fastnlp/fastHan/assets/22993056/a8085276-e3c6-4e36-860a-cc960b137579)

### System Info / 系統信息 vllm==0.8.5.dev92+g5c9121203.precompiled transformers==4.51.3 ### Who can help? / 谁可以帮助到您? _No response_ ### Information / 问题信息 - [ ] The official example scripts / 官方的示例脚本 - [...