airflow
airflow copied to clipboard
Refactor Datapipeline operators and fix system tests
This PR:
Removes datapipeline module from Google provider Moves all the related operators inside Dataflow service, based on the API that is used inside operators Adds new DataflowCreatePipeline, DataflowRunPipelineOperator and DataflowDeletePipelineOperator Adds new system test file for new operators
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst
or {issue_number}.significant.rst
, in newsfragments.