server icon indicating copy to clipboard operation
server copied to clipboard

How to make different model version use different config?

Open niuzheng168 opened this issue 2 years ago • 2 comments

My model have two versions, version 2 has different input shape and has additional output than model 1. I tried write 2 config for version 1 and version 2 but seems not work. So how to write the config.pbtxt to let server load the 2 version model correctly?

  <model-repository-path>/
    <model-name>/
      config.pbtxt
      config2.pbtxt ------- not work
      1/
        model.onnx
      2/
        model.onnx

niuzheng168 avatar Aug 31 '22 07:08 niuzheng168

This is not currently possible. What use case do you need this feature for? It looks like you've essentially got two different models with their own configs. Typically, users would put each model in its own folder.

dyastremsky avatar Aug 31 '22 20:08 dyastremsky

The structure which @dyastremsky is discussing would look something like

<model-repository-path>/
    <model-name>/
      config.pbtxt
      1/
        model.onnx
    <model-name-2>/
      config2.pbtxt 
      1/
        model.onnx

nv-kmcgill53 avatar Sep 02 '22 17:09 nv-kmcgill53

Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this.

krishung5 avatar Oct 11 '22 00:10 krishung5