modelmesh-serving
modelmesh-serving copied to clipboard
Allow config of id extraction for custom gRPC service methods
Applies to custom runtimes which use gRPC service interfaces other than the standard KFSv2 one. Currently the mm-vmodel-id
header must still be used for these.
Add a section in the config yaml which contains a map of fully qualified gRPC service method names to a map/object containing a field called idExtractionPath
whose value is a list of ints (in future other per-method fields might be supported).
The controller will use this to augment the model-mesh config secret that it already maintains for providing the id extraction paths.
Just adding a bit more context:
The current configuration that specifies the idExtractionPath
for rpcConfigs
is JSON content hard-coded into cluster_config.go. The implementation for this issue would allow that list to be extended with more entries baed on configuration for the controller.