Vamshidhar Dantu

I am convinced that MANIFEST is the right place to put this configuration in. I am gathering other customer use cases for this feature, to back this feature.

@maaquib @dhanainme

@tahouse : The result is indeed very funny. I think we might need to look into the resnet-50 model. To unblock yourself, I would recommend taking any resnet-50 model (from...

@tahouse : Could you share the reproducible steps? Since its a pretrained model, please provide the exact steps of how you prepared the model artifacts and how you ran model-archiver...

@mikeobr : Thanks for raising this issue. We will look into how to get functionality in.

@ThomasDelteil : Thanks for pointing this out. Can you specify which AWS host did you test this on?

@ThomasDelteil pointed out how MXNet deals with this as follows: https://github.com/apache/incubator-mxnet/blob/992c3c0dd90c0723de6934e826a49bad6569eeac/include/mxnet/base.h#L420 MMS could extract this logic and make it a standalone module that can be used by MMS.

We will look into this.

MMS just returns a 507 error for synchronous API calls, if that API caused an OOM. You would have to rely on HTTP error codes to handle the errors and...

We had a round of discussion and decided to keep "--start/--stop" optional. Its currently not mandatory. We stuck to "--" because its more python'ic way to describe arguments.