metaflow icon indicating copy to clipboard operation
metaflow copied to clipboard

Make Kubernetes default resources configurable

Open martinhausio opened this issue 1 year ago • 2 comments

This fixes https://github.com/Netflix/metaflow/issues/1769.

A quick addition that looks if the METAFLOW_KUBERNETES_CPU, METAFLOW_KUBERNETES_MEMORY, METAFLOW_KUBERNETES_DISK environment variable is set and if so parses the values. If a value is detected as being an attribute, then assign it, otherwise it will just use the default values as defined.

martinhausio avatar Apr 11 '24 21:04 martinhausio

I have tested locally by doing pip install ., then instantiating the same workflow with and without the environment variable and this behaves as intended.

I tested setting cpu, memory and disk separately, and together successfully.

martinhausio avatar Apr 11 '24 21:04 martinhausio

@saikonen , changes ready for your review!

martinhausio avatar May 02 '24 14:05 martinhausio