Anthony Ross
Anthony Ross
@skaes are you looking for beta users for this before merging? This PR is very large so I don't see how anyone will be able to thoroughly review and test...
Thanks @chrisroberts for the quick reply. Putting `response_wait: 0` did work but is a little unsafe for us in a production environment. I was able to get it to work...
For those new to this like I was, here is what I had to do: ```python client = boto3.client('application-autoscaling') client.register_scalable_target( ServiceNamespace='sagemaker', ResourceId="endpoint/" + endpoint_name + "/variant/AllTraffic", ScalableDimension='sagemaker:variant:DesiredInstanceCount', MinCapacity=4, MaxCapacity=50, RoleARN=role,...
@esergion - you're gist is gone, can you edit?
@aklinker1 is this ready now?