cenedella

icon indicating a website link cenedella.com

icon company Leet Resumes Inc. icon location New York City icon location Founder of Leet Resumes www.leetresumes.com Founder of Ladders ldd.rs/jobs Amazon #1 Bestselling author: ldd.rs/amzn

Results 3 comments of cenedella

Json parsing issue when using openai.Completion.acreate(stream=True)

I'm seeing this issue in PROD with bulk async requests @athyuttamre . I validated the JSON and tried a number of other ways to avoid it but still get "...

Json parsing issue when using openai.Completion.acreate(stream=True)

any thoughts @hallacy @ellisonbg @athyuttamre ? recurring error using openai 0.27.6

Multiple Async calls to the api fail catastrophically

Good call, and that’s worth looking in to. In PROD we are fewer than 1/second. Peak testing has been 16,000/ hour, so we haven’t come close to our rate limit...