one-api
one-api copied to clipboard
DeepSeek 流式输出最后记录 role = null
例行检查
- [x] 我已确认目前没有类似 issue
- [x] 我已确认我已升级到最新版本
- [x] 我已完整查看过项目 README,尤其是常见问题部分
- [x] 我理解并愿意跟进此 issue,协助测试和提供反馈
- [x] 我理解并认可上述内容,并理解项目维护者精力有限,不遵循规则的 issue 可能会被无视或直接关闭
问题描述
DeepSeek 流式输出最后记录 role = null
官方api 输出: { "id": "c71316c0-c2ff-4702-8e29-b201dffbf084", "choices": [ { "index": 0, "delta": { "content": "", "role": null }, "finish_reason": "stop", "logprobs": null } ], "created": 1715574938, "model": "deepseek-chat", "system_fingerprint": null, "object": "chat.completion.chunk", "usage": { "prompt_tokens": 10, "completion_tokens": 37, "total_tokens": 47 } } one-api 输出: { "id": "f6b7c79f-0bc5-46b4-8865-572e04d78675", "choices": [ { "index": 0, "delta": { "content": "", "role": null }, "finish_reason": "stop", "logprobs": null } ], "created": 1715571416, "model": "deepseek-chat", "system_fingerprint": null, "object": "chat.completion.chunk", "usage": { "prompt_tokens": 10, "completion_tokens": 52, "total_tokens": 62 } }
预期结果
虽然官方api输出的也是role = null , 希望oneapi 可以处理最后一条消息,正常输出 “assistant”
同样问题,楼主有微信吗
这类问题。。。应该去和 speedchat 反馈更合适 🤣
https://github.com/deepseek-ai/DeepSeek-V2
当结尾 "finish_reason":"stop"
时,role
值为空。
data: {"id":"2c0e9145-0ef9-4037-a5b0-590c6df994b0","choices":[{"index":0,"delta":{"content":".","role":"assistant"},"finish_reason":null,"logprobs":null}],"created":1715667871,"model":"deepseek-chat","system_fingerprint":null,"object":"chat.completion.chunk"}
data: {"id":"2c0e9145-0ef9-4037-a5b0-590c6df994b0","choices":[{"index":0,"delta":{"content":"","role":null},"finish_reason":"stop","logprobs":null}],"created":1715667871,"model":"deepseek-chat","system_fingerprint":null,"object":"chat.completion.chunk","usage":{"prompt_tokens":8,"completion_tokens":27,"total_tokens":35}}
你其实可以补充说一下,用什么框架或代码,因为这个报错了。
同样问题,楼主有微信吗
@yooohk333 你如果有偿还好说,开源项目用爱发电,500个 issue 都去找本人不得崩了(
不过,说来,如果有交流群或电报群之类就好了~