ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Question]: answer won't follow the output format specified in the system prompt

Open tonyzzzzz opened this issue 10 months ago • 1 comments

Self Checks

  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (Language Policy).
  • [x] Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
  • [x] Please do not modify this template :) and fill in all the required fields.

Describe your problem

we have a ragflow + ollama (deepseek) system deployed on a Linux box. We tried to fixed the answer format by using system prompt. However, the answer from RAGFlow won't keep the format. As a comparasion, ollama with the same system prompt (via open-UI) doesn't have this issue, i.e., all the anwers follow the format specified by the system prompt. The model configurations are the same for both (e.g., temp = 0.1, top-k = 0.3 etc.).

tonyzzzzz avatar Mar 12 '25 04:03 tonyzzzzz

The system prompt in RAGFlow will be filled with retrieved content, which might be long.

KevinHuSh avatar Mar 12 '25 04:03 KevinHuSh