dspy
dspy copied to clipboard
Support OpenAI Batch requests.
Can we support OpenAI Batch requests.
Example use cases are classification, translation etc.
Reference: https://twitter.com/OpenAIDevs/status/1779922566091522492
https://platform.openai.com/docs/api-reference/batch
Feel free to open a PR @pranavchat14 ! dspy.OpenAI
points to request-calling logic in gpt3.py, which can be adapted to batched requests. If this would not support the current caching logic, we can look into adapting an OpenAIBatched class to handle this.