[Feature Request]: Compile model w/ NEO to target AWS Lambda

[ecurtin2]

Hey all, thanks for the nice software!

I've been struggling to find a good way to deploy a sagemaker model in a serverless fashion.

It seems like a great solution would be to compile a trained model using NEO to target the AWS lambda runtime. Perhaps even this could be added to a lambda layer.

Thus the serverless deployment of a sagemaker model would be to simply compile -> include a layer in a lambda function and invoke that lambda using whatever techniques are appropriate for the problem.

Is this a thing that's in the pipeline? I tried to do it myself but I had a tough time figuring out how the various components work.

[mvsusp]

Hi @ecurtin2 ,

Although your suggestion would result in a very nice feature, we do not have any immediate plans to work on it.

Please, let me know if you have additional questions.

Thanks for using SageMaker!

[marcelpanse]

Would love this!

[jorisgu]

This would be amazing!

[j-adamczyk]

+1, this would be great. Additionally, support for SageMaker Serverless should be added in the similar fashion.