modelmesh-serving icon indicating copy to clipboard operation
modelmesh-serving copied to clipboard

Allow config of id extraction for custom gRPC service methods

Open njhill opened this issue 2 years ago • 1 comments

Applies to custom runtimes which use gRPC service interfaces other than the standard KFSv2 one. Currently the mm-vmodel-id header must still be used for these.

Add a section in the config yaml which contains a map of fully qualified gRPC service method names to a map/object containing a field called idExtractionPath whose value is a list of ints (in future other per-method fields might be supported).

The controller will use this to augment the model-mesh config secret that it already maintains for providing the id extraction paths.

njhill avatar Sep 07 '22 23:09 njhill

Just adding a bit more context: The current configuration that specifies the idExtractionPath for rpcConfigs is JSON content hard-coded into cluster_config.go. The implementation for this issue would allow that list to be extended with more entries baed on configuration for the controller.

tjohnson31415 avatar Feb 19 '24 19:02 tjohnson31415