Add model TFServing deployment example

Open piotrlaczkowski opened this issue 4 years ago • 2 comments

Hi There!

It would be a great help if you could provide an example (docs or notebook) of how to deploy this kind of model (step by step) using TFServing (on AWS Sagemaker or similar). I guess we will need some custom pre and post-processing functions to be set up in order to make it work with .i.e. Sagemaker Endpoints?

THNX!

Sep 22 '21 13:09 piotrlaczkowski

Would be great to have the model containerized and using the kfserving/ tfserving/ TRITON ..etc serving framework to run on GCP Vertex AI model deploy :)

Sep 24 '21 03:09 giranntu

I am really looking for a way to deploy a saved similarity model using TFServing itself. The way to do it is not clear since we need a custom object + index loading when loading method for inference. Anyone can help ?

May 12 '22 07:05 piotrlaczkowski