kedro-airflow

kedro-airflow copied to clipboard

[KED-1426] Handling of out of catalog items

2

## Description Airflow requires that data is persisted between nodes, thus out of catalog entries or MemoryDatasets are not supported. ## Context The process of converting all I/O to become...

nikos-kal

DAG for Google Composer

2

## Description It would be nice if the kedro-airflow generated DAGs were ready for deploy at Google Composer / other cloud vendors. ## Context I think that it might help...

cabjr

## Description and Context I'd love to know opinions on the idea of allowing extra options as input to the *dags* creation tool, in particular regarding the [executor_config](https://airflow.apache.org/docs/apache-airflow/stable/_modules/airflow/example_dags/example_kubernetes_executor_config.html). This could...

stefanondisponibile

[KED-1541] DockerOperator workflow

2

## Description Use `DockerOperator`s that run commands of the project's docker image, instead of `PythonOperator`s. ## Context It greatly simplifies dependency management: dependency management is "outsourced" to DAG creation rather...

seeM