aws-step-functions-data-science-sdk-python icon indicating copy to clipboard operation
aws-step-functions-data-science-sdk-python copied to clipboard

Published 20 hours ago • verified publisher icon aws

feature: adding support for AsyncInferenceConfig in endpoint config

Open Luca-Ferrera opened this issue 3 years ago • 1 comments

The EndpointConfig constructor could be extended to support passing in AsyncInferenceConfig which includes configuration as shown here in the doc API_AsyncInferenceConfig In this way would be possible to create an EndpountConfig supporting Asynchronous Inference.

Luca-Ferrera avatar Sep 28 '21 10:09 Luca-Ferrera

Hi @Luca-Ferrera, I can see this being used by many of our customers - this will be a great feature to add to the Data Science SDK. Thank you for bringing this to our attention.

ca-nguyen avatar Sep 30 '21 17:09 ca-nguyen