Marquez support in OpenLineage connector

[dechoma]

trafficstars

Describe your changes:

Fixes

Currently OpenLineage connector supports only Kafka as a source of OpenLineage events In this PR we will introduce support for Marquez which is an reference implementation of the OpenLineage standard

Type of change:

• [ ] Bug fix
• [ ] Improvement
• [x] New feature
• [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
• [ ] Documentation

Checklist:

• [x] I have read the CONTRIBUTING document.
• [ ] My PR title is Fixes <issue-number>: <short explanation>
• [ ] I have commented on my code, particularly in hard-to-understand areas.
• [ ] For JSON Schema changes: I updated the migration scripts or explained why it is not needed.

[github-actions[bot]]

Hi there 👋 Thanks for your contribution!

The OpenMetadata team will review the PR shortly! Once it has been labeled as safe to test, the CI workflows will start executing and we'll be able to make sure everything is working as expected.

Let us know if you need any help!

[dolfinus]

This is closed because ...?

[dechoma]

We needed to refactor the OpenLineage connector first. The pull request for refactor is almost ready, and then we can add Marquez integration on top of refactored approach.