async pipeline

[gesaleh]

trafficstars

i have the following configuration openwebui - pipeline - API call (asyncio) custom_microservice (workflow, RAG,....)

when i use def pipe as sync all work good I updated the microservice to perform response streaming with event of my workflow chain when i move the pipe to async i have no control anymore on the ui I see the POST request coming to pipeline docker but i never receive it on the API microservice how to control the status and make the pipeline receive the stream

there is no example of such pipeline ? is it possible to have such solution ?

[tonicebrian]

@gesaleh Have you found how to run Async Pipelines. I cannot find any example and just doing ainvoke does not work at all.

[dominikpeter]

As the pipe is currently handled, it only supports synchronous functions code where the pipe is loaded We would also like to use ainvoke in a langchain / langgraph pipeline. I can take a look at it and do a PR.