dspy icon indicating copy to clipboard operation
dspy copied to clipboard

Published 20 hours ago • verified publisher icon stanfordnlp

Support OpenAI Batch requests.

Open pranavchat14 opened this issue 4 months ago • 1 comments

Can we support OpenAI Batch requests.

Example use cases are classification, translation etc.

Reference: https://twitter.com/OpenAIDevs/status/1779922566091522492

https://platform.openai.com/docs/api-reference/batch

pranavchat14 avatar Apr 22 '24 10:04 pranavchat14

Feel free to open a PR @pranavchat14 ! dspy.OpenAI points to request-calling logic in gpt3.py, which can be adapted to batched requests. If this would not support the current caching logic, we can look into adapting an OpenAIBatched class to handle this.

arnavsinghvi11 avatar Apr 27 '24 23:04 arnavsinghvi11