Supporting MTCNN style model serving?

[windsorwho]

Hi there,

Great framework for serving mxnet based models!

I wonder if there is any suggestions on supporting multi-stage models such as MTCNN, https://github.com/pangyupo/mxnet_mtcnn_face_detection/tree/master/model?

Usually the entire model is composed of a cascade of several small models each with their own symbol and param file. However, the current design seems can only deal with one model per service. Any suggestions?

[lupesko]

Thanks for trying out MMS, and glad you like it! Please star, fork and share with your friends and colleagues!

As for multi-stage cascading models: actually you can implement it today with MMS, but it requires some manual work; you can package up all of the model files together, add custom code with init override to manually load all models, and then override the inference method to run a cascading inference. Try it out and let us know how it goes - we'd love for you to contribute this model to the model zoo.

Let's keep this issue open, we can consider adding a built-in support for MTCNN, and if you are interested in this you can also contribute this enhancement.

[yuruofeifei]

Hi @windsorwho, Thank you for the suggestion. Currently, multi model serving is supported, BUT they can only share one custom services. I also have a plan to add support to package multiple models with different custom codes. Our schema does support this extension. Only Implementation is the gap. I will create a PR for this extension soon, thanks!