OpenLLM icon indicating copy to clipboard operation
OpenLLM copied to clipboard

Published 20 hours ago • verified publisher icon bentoml

feat(client): support wait time for serverless startup time

Open aarnphm opened this issue 1 year ago • 0 comments

ideally, when the bento running on bentocloud is on serverless, the client should be able to retry connection until the pod is alive

aarnphm avatar Nov 10 '23 22:11 aarnphm