modelmesh-serving
modelmesh-serving copied to clipboard
Allow users to configure serving runtimes on a namespace basis.
Currently, https://github.com/kserve/modelmesh-serving/tree/main/docs/configuration operates on a global level. Ideally we'd allow users to create these configs at a namespace level at the highest precedence. So, the order of priority of configs would be:
modelmesh Defaults < global configmap < namespace configmap
This is somewhat related to #263
I'll just note that serving runtime specific configuration should mostly be reflected in the ServingRuntime CRD itself. What we are talking about here is more cross-cutting configuration that applies to all runtimes or is orthogonal.
Probably this wouldn't be applicable to every one of the current "global" config parameters, but would make sense for a subset.