dspy icon indicating copy to clipboard operation
dspy copied to clipboard

Is it possible to make concurrent for every lm api calls?

Open Hspix opened this issue 6 months ago • 2 comments

There are many llm api calls during pipeline optimization. Does DSPY support asynchronous calls to LLMs yet? When trainset size up to hundreds level, the current sequential execution is too time-consuming and takes hours. I'm looking for ways to optimize the process and speed it up. Thanks.

Hspix avatar Aug 03 '24 10:08 Hspix