dify icon indicating copy to clipboard operation
dify copied to clipboard

"Output Anomalies in DIFY When Handling Long Content: Issues with Text Repetition and Formatting"

Open mengdahuang opened this issue 6 months ago • 7 comments

Self Checks

  • [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [X] I have searched for existing issues search for existing issues, including closed ones.
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [X] Please do not modify this template :) and fill in all the required fields.

Dify version

0.6.16

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Dear DIFY Team,

Fault Description: When DIFY outputs content, if the content is too long, the text and formatting at the end become uncontrollable (such as repetition, garbled text, excessive spacing, and other anomalies). iShot_2024-08-08_09 52 56 iShot_2024-08-08_09 50 45

Reproduction Steps: Initially, I suspected it was an issue with the capabilities of the gpt-4o model. However, when I imported the same knowledge document into both DIFY and FASTGPT and requested both to output all content from the knowledge base (or a specific point, as long as there is enough content), I found that: FASTGPT's output was normal, but DIFY's output was abnormal. iShot_2024-08-08_09 46 00

So, I conducted a second round of testing:

I integrated the normal output from FASTGPT as an API into DIFY's workflow (using DIFY's HTTP request module). I disabled DIFY's own knowledge base and directly used the FASTGPT API via HTTP requests. At this point, I found that the FASTGPT API output was normal, but the content transmitted to DIFY still exhibited the aforementioned anomalies. iShot_2024-08-08_09 54 52


"I have to add that this is not just a web rendering issue. By using the workflow mentioned above, I published DIFY as an application and queried it through the DIFY API with the same long text content. I also encountered formatting issues, typos, and other anomalies as described above."

Look forward to your reply, thank you!

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

mengdahuang avatar Aug 08 '24 01:08 mengdahuang