generative-ai-python icon indicating copy to clipboard operation
generative-ai-python copied to clipboard

Retry / warning / default off

Open LindaLawton opened this issue 10 months ago • 1 comments

Description of the feature request:

We support retry in this library operations.py#L84

What problem are you trying to solve with this feature?

As of yet it is unclear if we will be billed when we get 500 errors from the api.

This means that retry has the potential of costing a developer a lot of money if it retries without their knowledge.

Any other information you'd like to share?

I would like to suggest that retry be documented disabled by default if its not currently.

And a warning about possible billing issues be added to the readme.

LindaLawton avatar Apr 24 '24 06:04 LindaLawton

I got something back from the team that says we will not be charged for 500 and 400 errors. I'm just waiting for it to be documented some place.

LindaLawton avatar Apr 28 '24 09:04 LindaLawton