kedro-airflow-k8s icon indicating copy to clipboard operation
kedro-airflow-k8s copied to clipboard

Compile step broken with kedro==0.18.0

Open mwiewior opened this issue 3 years ago • 3 comments

Steps to reproduce:

  1. install kedro==0.18.0
  2. Run kedro airflow-k8s compile:
bash-3.2$ kedro airflow-k8s -e pipelines compile
Traceback (most recent call last):
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/bin/kedro", line 8, in <module>
    sys.exit(main())
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/kedro/framework/cli/cli.py", line 268, in main
    cli_collection = KedroCLI(project_path=Path.cwd())
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/kedro/framework/cli/cli.py", line 181, in __init__
    self._metadata = bootstrap_project(project_path)
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/kedro/framework/startup.py", line 181, in bootstrap_project
    configure_project(metadata.package_name)
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/kedro/framework/project/__init__.py", line 219, in configure_project
    settings.configure(settings_module)
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/dynaconf/base.py", line 182, in configure
    self._wrapped = Settings(settings_module=settings_module, **kwargs)
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/dynaconf/base.py", line 235, in __init__
    self.validators.validate(
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/dynaconf/validator.py", line 417, in validate
    validator.validate(self.settings, only=only, exclude=exclude)
  File "/Users/mwiewior/job/projects/PKOBP/git/kedro-airflow-k8s/venv/kedro/lib/python3.8/site-packages/dynaconf/validator.py", line 197, in validate
    self._validate_items(
TypeError: _validate_items() got an unexpected keyword argument 'only'

  1. Downgrading to kedro 0.17.x resolves the issue
kedro --version
kedro, version 0.17.5

mwiewior avatar Sep 29 '21 04:09 mwiewior

@mwiewior I think it's issue of Kedro itself, see: https://github.com/quantumblacklabs/kedro/commit/d36fce90f23a79990ea6470ad2ef9b3f1a4779bf

I observe same on Kedro 0.17.4, upgrading to 0.17.5 helps

szczeles avatar Oct 01 '21 09:10 szczeles

@mwiewior Did you mean kedro==0.17.0? Title says 0.18.0, but at this very time such version does not exist.

Hi - checking in from the Kedro team here - we're hard at work on the 0.18.0 expected early 2022. If you have a copy handy we could release that instead :)

datajoely avatar Nov 17 '21 15:11 datajoely