metaflow
metaflow copied to clipboard
Make Kubernetes default resources configurable
This fixes https://github.com/Netflix/metaflow/issues/1769.
A quick addition that looks if the METAFLOW_KUBERNETES_CPU, METAFLOW_KUBERNETES_MEMORY, METAFLOW_KUBERNETES_DISK environment variable is set and if so parses the values. If a value is detected as being an attribute, then assign it, otherwise it will just use the default values as defined.
I have tested locally by doing pip install ., then instantiating the same workflow with and without the environment variable and this behaves as intended.
I tested setting cpu, memory and disk separately, and together successfully.
@saikonen , changes ready for your review!