intel-extension-for-transformers icon indicating copy to clipboard operation
intel-extension-for-transformers copied to clipboard

Published 20 hours ago • verified publisher icon intel

Frontend(gradio) string output is not like streaming

Open redhairerINTEL opened this issue 9 months ago • 4 comments

stream default is True but string output is not like streaming image

redhairerINTEL avatar Apr 30 '24 12:04 redhairerINTEL

Thanks for reporting it, we will check the issue

kevinintel avatar May 01 '24 15:05 kevinintel

Hi, @redhairerINTEL, can you paste your codes and env version so that I can reproduce your issue? Thanks

zhentaoyu avatar May 10 '24 06:05 zhentaoyu

Per discussion, I used neuralchat as backend and gradio as frontend. If you are not right owner, please help to assign to right owner.

redhairerINTEL avatar May 12 '24 01:05 redhairerINTEL

Hi, @lvliang-intel, @letonghan, I'm not familiar with the neural chat streaming. could you please help with this issue? Thanks a lot.

zhentaoyu avatar May 13 '24 01:05 zhentaoyu