Implement OpenLineage extractor for Redshift async operators

[pankajkoti]

Implement OpenLineage extractor for Redshift async operators

• [x] RedshiftSQLOperatorAsync
• [x] RedshiftDataOperatorAsync

[rajaths010494]

Broken plugin: [openlineage.airflow.plugin] Failed to import astronomer.providers.amazon.aws.extractors.redshift.RedshiftAsyncExtractor . Update OL version to 0.10.0 and 0.11.0 and tried the same issue exists. Connect with @pankajkoti and try to resolve this.

[pankajkoti]

Current issue is that with the latest Astro image and recent OpenLineage releases 0.9.0, 0.10.0 & 0.11.0 the plugin load is failing for Redshift Extractor. @rajaths010494 to connect with Maciej (GetInData team) and dig deeper into resolving this issue today.

[rajaths010494]

Waiting for PR to be raised from Ol side so that i can review and implement the same in our extractor

[pankajkoti]

We can refer to this page: https://www.notion.so/astronomerio/Developing-OpenLineage-in-Astro-9f30a74c74354f168279c1205f4d89a6 to install local packages

[rajaths010494]

Today have a connect with maciej for broken plugin issue.

[rajaths010494]

Draft PR has been raised https://github.com/astronomer/astronomer-providers/pull/561

[rajaths010494]

Test cases are pending

[bharanidharan14]

Expected to be completed EOD

[rajaths010494]

New version of openlineage-airflow==0.12.0 has been released, will revamp unwanted code and then push the changes

[rajaths010494]

Have incorporated the new openlineage-airflow==0.12.0 code for redshift extractors.

[phanikumv]

are we ready with the PR for this? It is in draft state at the moment.

[rajaths010494]

Ready for review and i have rebased