replicate-js icon indicating copy to clipboard operation
replicate-js copied to clipboard

Configurable retry requests on 50x etc responses

Open creatorrr opened this issue 2 years ago • 2 comments

Perhaps using https://github.com/adobe/node-fetch-retry

creatorrr avatar Aug 05 '22 06:08 creatorrr

Can you tell me a bit more about the kind of issue you've run into and the kind of retry behavior you're interested in configuring?

nicholascelestin avatar Aug 07 '22 19:08 nicholascelestin

I used a few different platforms (replicate, huggingface, openai) for a project recently and noticed that they returned quite a few transient errors on API calls mostly around models loading up etc. I found that retrying most of them resulted in a success.

creatorrr avatar Aug 09 '22 11:08 creatorrr