amazon-sagemaker-operator-for-k8s icon indicating copy to clipboard operation
amazon-sagemaker-operator-for-k8s copied to clipboard

Published 20 hours ago • verified publisher icon aws

Async Endpoint Request

Open dferguson992 opened this issue 1 year ago • 1 comments

Hello!

Will there be any support for Async Inference Endpoints?

dferguson992 avatar Jul 14 '22 20:07 dferguson992

Hi @dferguson992, thanks for the feature request. Support for Asynchronous Inference Endpoint is available in the latest SageMaker operator based on the ACK framework. Here are the parameters you need to specify in EndpointConfig CR: https://github.com/aws-controllers-k8s/sagemaker-controller/blob/main/config/crd/bases/sagemaker.services.k8s.aws_endpointconfigs.yaml#L39-L71

If you are new to ACK service controller for SageMaker, here is a tutorial to get you started: https://aws-controllers-k8s.github.io/community/docs/tutorials/sagemaker-example/

surajkota avatar Jul 14 '22 21:07 surajkota