langserve
langserve copied to clipboard
Streaming RemoteRunnable not working w/ rag-chroma-private
Testing rag-chroma-private.
for -
from langserve.client import RemoteRunnable
rag_app = RemoteRunnable('http://0.0.0.0:8001/rag_chroma_private/')
this returns a generator -
rag_app.stream("How does agent memory work?")
and this returns the answer as a single item -
for item in rag_app.stream("How does agent memory work?"):
print(item)
Same problem here
Same here. I got it to stream to stdout by adding a StreamingStdOutCallbackHandler, so the problem must be somewhere down the line.