scaleapi-python-client icon indicating copy to clipboard operation
scaleapi-python-client copied to clipboard

Published 20 hours ago • verified publisher icon scaleapi

Issue with deployment endpoints on ScaleAI

Open teknium1 opened this issue 1 year ago • 0 comments

When I use scaleAI's deployment endpoint, if the generated text doesnt get sent back within ~30s, I get an error about a 504 error.

If the response comes back quickly, I dont.

This makes it very difficult to use for long text generation from GPTx's. Setting timeout in my request to 5mins does not change it, so I think its on Scale's end

teknium1 avatar Mar 24 '23 09:03 teknium1