multi-model-server
multi-model-server copied to clipboard
define inference proto
This feature requires
- define inference messages in proto
- apply protobuf encode/decode in inference endpoints
- add test cases