OpenMetadata
OpenMetadata copied to clipboard
Ingestion Docker Image based on Airflow 2.3.3
Is your feature request related to a problem? Please describe. Currently, the Ingestion image being created is building all the dependencies during docker image build (airflow-managed-apis and openmetadata-ingestion python packages). We should rather use the published python packages to create and ship the docker image.
This is the standard we follow for OpenMetadata Server Docker images. Let's create the same for OpenMetadata Ingestion Airflow docker image as well.
Describe the solution you'd like Split and refactor the current Ingestion docker images -
- one for Production Release and publish
- second one for development and CI Workflows.