simple_tensorflow_serving icon indicating copy to clipboard operation
simple_tensorflow_serving copied to clipboard

Loading and Unloading versions of model

Open dharmendrach opened this issue 6 years ago • 2 comments

Usually systems which are in production require, loading of new versions on run-time and even unloading previous versions of model. Is there any way to achieve same using this framework ? I have seen tensorflow serving does this via constantly checking file system for new model versions and unloading deleted models.

I really like idea of single framework for hosting different framework models. If you have some tasks for future releases or any contribution required, I can help.

dharmendrach avatar Dec 05 '19 09:12 dharmendrach

@drc10723 I was also hoping to find a way to handle hot-reload of the server based on the changes in the config file! Have you solved it? if so, I would be curious to learn as well.

marooned20 avatar Feb 02 '21 11:02 marooned20

We can not hot-reload models with config file or using non-tensorfllow models now. We may use load balancer or AB testing tools for this scenario.

tobegit3hub avatar Feb 03 '21 02:02 tobegit3hub