byzer-llm icon indicating copy to clipboard operation
byzer-llm copied to clipboard

Published 20 hours ago • verified publisher icon allwefantasy

llm流式接口推理数据重复问题

Open Hansen523 opened this issue 1 year ago • 0 comments

  • 现象

调用llm.stream_chat_oai接口，前后推理的重复数据较多 image

  • 排查 通过本地加打点debug，发现是同一条数据被get_item多次导致 image image

Hansen523 avatar Jan 06 '24 07:01 Hansen523