continue icon indicating copy to clipboard operation
continue copied to clipboard

Implement graceful handling of requests/rate limits

Open vaivanov95 opened this issue 8 months ago • 5 comments

Validations

  • [x] I believe this is a way to improve. I'll try to join the Continue Discord for questions
  • [x] I'm not able to find an open issue that requests the same enhancement

Problem

Currently if during response generation an HTTP 429 code is returned from e.g. Anthropic API, the generation process halts an an error is displayed.

Solution

Potential solution

  • suspend the generation for a minute and then continue
    • while the generation is suspended display a message explaining the situation: "API usage limit exceeded, retrying after (counting)"
    • display a button to trigger a retry immediately

vaivanov95 avatar Feb 09 '25 18:02 vaivanov95