Async support for pipe

[almajo]

Hi,

I was wondering why there was no async version of pipe available? I have a rag module that can be run completely asynchronous with different calls to LLMs and Vector stores. I would love if we could use an AsyncGenerator as well as a return type for the pipe.

Any thoughts on that?

As most pipelines are calls to other APIs, Async support would make a lot of sense in my opinion.

[bahrikutlu]

You should be able to start an event loop inside the synchronous pipe function and process multiple tasks in parallel. Starting an LLM conversation to generate the boilerplate code is a good start. That is how I figured it out.