WANG AOHAN

**功能描述 / Feature Description** model_config.py,除了定义PROMPT_TEMPLATE,再增加定义system message **解决的问题 / Problem Solved** 将system message和PROMPT_TEMPLATE混在一起，会导致LLM回答超出知识库范围的东西，建议将system message和知识库分开。这样就减少了回答知识库以外的内容的概率 。 **实现建议 / Implementation Suggestions** 先将system message送到模型，然后再将搜索到的相关知识和问题送给模型。 **替代方案 / Alternative Solutions** 无 **其他信息 / Additional Information** 在gpt4上测试，system...

**Is your feature request related to a problem? Please describe.** I'm always frustrated when reverse_proxy with websocket .Streaming output like gpt **Describe the solution you'd like** {"level":"info","ts":1721899225.2968636,"logger":"http.log.access.log1","msg":"handled request","request":{"remote_ip":"6.11.1.7","remote_port":"37900","client_ip":"6.11.1.7","proto":"HTTP/2.0","method":"POST","host":"api.aigc.it","uri":"/v1/messages","headers":{"Priority":["u=1, i"],"Sec-Ch-Ua":["\"Not/A)Brand\";v=\"8\", \"Chromium\";v=\"126\",...