dspy
dspy copied to clipboard
Is it possible to make concurrent for every lm api calls?
There are many llm api calls during pipeline optimization. Does DSPY support asynchronous calls to LLMs yet? When trainset size up to hundreds level, the current sequential execution is too time-consuming and takes hours. I'm looking for ways to optimize the process and speed it up. Thanks.