kedro-airflow-k8s icon indicating copy to clipboard operation
kedro-airflow-k8s copied to clipboard

Update kedro dependencies

Open em-pe opened this issue 2 years ago • 1 comments

Update plugin dependencies to recent versions:

kedro - 0.18.*

em-pe avatar Jul 05 '22 21:07 em-pe

Support for further versions of kedro, airflow and mlflow

This plugin requires dependency updates, with probable breaking changes. This prevents users from using latest and greatest mlflow, kedro and airflow versions which is not only important feature-wise but also from the security standpoint as there are critical CVEs.

Looking at setup.py - the culprits are:

Kedro locked to an old version

"kedro>=0.16, <0.18",

Dependent plugin which prevents update to MLFlow 2.X

kedro-mlflow==0.4.1"

Outdated Airflow Plugins

"apache-airflow[kubernetes]==2.1.0", "apache-airflow-providers-cncf kubernetes==1.1.0", "apache-airflow-providers-apache-spark==2.0.1"\

dgajewski1 avatar Jun 20 '23 11:06 dgajewski1