server
server copied to clipboard
How to make different model version use different config?
My model have two versions, version 2 has different input shape and has additional output than model 1. I tried write 2 config for version 1 and version 2 but seems not work. So how to write the config.pbtxt to let server load the 2 version model correctly?
<model-repository-path>/
<model-name>/
config.pbtxt
config2.pbtxt ------- not work
1/
model.onnx
2/
model.onnx
This is not currently possible. What use case do you need this feature for? It looks like you've essentially got two different models with their own configs. Typically, users would put each model in its own folder.
The structure which @dyastremsky is discussing would look something like
<model-repository-path>/
<model-name>/
config.pbtxt
1/
model.onnx
<model-name-2>/
config2.pbtxt
1/
model.onnx
Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this.