modelmesh-serving icon indicating copy to clipboard operation
modelmesh-serving copied to clipboard

Allow users to configure serving runtimes on a namespace basis.

Open anishasthana opened this issue 2 years ago • 2 comments

Currently, https://github.com/kserve/modelmesh-serving/tree/main/docs/configuration operates on a global level. Ideally we'd allow users to create these configs at a namespace level at the highest precedence. So, the order of priority of configs would be:

modelmesh Defaults < global configmap < namespace configmap

anishasthana avatar Oct 21 '22 17:10 anishasthana

This is somewhat related to #263

anishasthana avatar Oct 21 '22 17:10 anishasthana

I'll just note that serving runtime specific configuration should mostly be reflected in the ServingRuntime CRD itself. What we are talking about here is more cross-cutting configuration that applies to all runtimes or is orthogonal.

Probably this wouldn't be applicable to every one of the current "global" config parameters, but would make sense for a subset.

njhill avatar Oct 26 '22 15:10 njhill