openai-cookbook icon indicating copy to clipboard operation
openai-cookbook copied to clipboard

add simpler parallel api request script + rename robust version so th…

Open joe-at-openai opened this issue 2 years ago • 2 comments
trafficstars

Adding a simple example of how to run a parallel API request (following https://gist.github.com/neubig/80de662fb3e225c18172ec218be4917a). Also renaming the more robust parallel API request script so they will both sit side by side alphabetically.

joe-at-openai avatar May 10 '23 21:05 joe-at-openai

Won't this simple version potentially hit rate limit errors?

ted-at-openai avatar May 18 '23 23:05 ted-at-openai

Yes definitely. At best it's a quick and dirty script useful for small scale things. Once people hit rate limits they would have to switch to the robust one.

joe-at-openai avatar May 27 '23 18:05 joe-at-openai

This PR is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Sep 27 '23 01:09 github-actions[bot]

Given that the purpose of the parallel script is to allow massive batch processing of requests, and not hitting API rate limits is a critical element of this, I'll be closing this PR for now. But thank you for your contribution nonetheless!

Something we could revisit is writing a notebook about parallel calls were we slowly build up to this script, and include simpler examples there.

simonpfish avatar Sep 27 '23 20:09 simonpfish