BricksLLM icon indicating copy to clipboard operation
BricksLLM copied to clipboard

How it handle errors

Open redigits-team opened this issue 1 year ago • 3 comments

We are developing some projects that occasionally trigger a 429 error due to exceeding our account’s usage limits, either because the applications make requests too quickly or because many users are using the applications simultaneously. Does BricksLLM handle this error by slowing down the requests to the OpenAI API, perhaps using retries or caching mechanisms?

redigits-team avatar Oct 07 '24 21:10 redigits-team