littlestone0806
littlestone0806
Please first search for your feature request under Issues or Discussions, maybe someone else already suggested it. **Is your feature request related to a problem? Please describe.** A clear and...
### Is there an existing issue for this? - [X] I have searched the existing issues ### Current Behavior 已经训练了200次,生成了一个模型。再次执行训练时,又从头开始跑了 ### Expected Behavior _No response_ ### Steps To Reproduce 已经训练了200次,生成了一个模型。再次执行训练时,又从头开始跑了...
发送请求时,stream参数为1请求流式输出。 发送请求格式如下: curl -X POST "http://127.0.0.1:8000" \ -H 'Content-Type: application/json' \ -d '{"prompt": "你好", "history": [], "stream":1}' 回复按照SSE流式输出格式 data:{ "response":"你好👋!我是人工智能助手 ChatGLM-6B,很高兴见到你,欢迎问我任何问题。", "history":[["你好","你好👋!我是人工智能助手 ChatGLM-6B,很高兴见到你,欢迎问我任何问题。"]], "status":200, "time":"2023-03-23 21:38:40" } 用客户端编写http测试,流式输出响应速度很快,效果如下 