dify icon indicating copy to clipboard operation
dify copied to clipboard

llm component does not have streaming reply

Open 305607610 opened this issue 9 months ago • 1 comments

Self Checks

  • [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template :) and fill in all the required fields.

Dify version

v1.0.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I use the question classification component, parameter extraction component, and http request component before the llm component. After that, the llm component will not return in a streaming manner, but will return all the text at once.

Image

Image

✔️ Expected Behavior

llm component streaming return

❌ Actual Behavior

llm component does not have streaming reply

305607610 avatar Mar 13 '25 06:03 305607610