ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard
verified publisher icon intel-analytics

codegeex4 使用lightweight serving搭建stream模式失败

Open juan-OY opened this issue 1 year ago • 1 comments

codegeex4 使用lightweight serving搭建stream mode在MTL上不成功。

juan-OY avatar Aug 19 '24 02:08 juan-OY

This issue cannot be reproduced on Arc, only on MTL. This may be caused by different scheduling methods of different systems. And it was fixed by this pr.

hzjane avatar Aug 19 '24 02:08 hzjane