GPTCache icon indicating copy to clipboard operation
GPTCache copied to clipboard

[Enhancement]:llm('hello')这样调用会执行langchain中LLM类的_call()方法,但是它只能return 一个str类型

Open CyanMystery opened this issue 2 years ago • 2 comments

What would you like to be added?

我想它应该支持流式输出 使用yield返回,因此,处理llm('hello')这样调用之外,最好能使用llm.custom_func()调用

Why is this needed?

支持流式输出

Anything else?

No response

CyanMystery avatar Jun 20 '23 08:06 CyanMystery

@jiangbossB It's a great advice!

SimFG avatar Jun 20 '23 08:06 SimFG

If you want to support streaming output, this should be supported in langchain, such as returning a generator

SimFG avatar Jun 26 '23 02:06 SimFG