hooli-data-eng-pipelines icon indicating copy to clipboard operation
hooli-data-eng-pipelines copied to clipboard

Add Airbyte

Open slopp opened this issue 2 years ago • 1 comments

Add an example that uses: https://hooli-airbyte.purina.elementl.dev/

One consideration with this example is deciding how to include it such that the repository still runs locally with minimal dependencies.

It may also be worth waiting until the airbyte-connections-as-code changes land.

airbyte-airbyte-webapp-svc.airbyte.svc.cluster.local

kubectl port-forward -n airbyte svc/airbyte-airbyte-webapp-svc 9000:80

Example starting point: https://github.com/dagster-io/dagster/tree/master/examples/assets_modern_data_stack

slopp avatar Oct 31 '22 16:10 slopp

Depends on https://github.com/dagster-io/dagster/pull/10224

slopp avatar Nov 01 '22 17:11 slopp