replicate-js
replicate-js copied to clipboard
Configurable retry requests on 50x etc responses
Perhaps using https://github.com/adobe/node-fetch-retry
Can you tell me a bit more about the kind of issue you've run into and the kind of retry behavior you're interested in configuring?
I used a few different platforms (replicate, huggingface, openai) for a project recently and noticed that they returned quite a few transient errors on API calls mostly around models loading up etc. I found that retrying most of them resulted in a success.