hooli-data-eng-pipelines
hooli-data-eng-pipelines copied to clipboard
Add Airbyte
Add an example that uses: https://hooli-airbyte.purina.elementl.dev/
One consideration with this example is deciding how to include it such that the repository still runs locally with minimal dependencies.
It may also be worth waiting until the airbyte-connections-as-code changes land.
airbyte-airbyte-webapp-svc.airbyte.svc.cluster.local
kubectl port-forward -n airbyte svc/airbyte-airbyte-webapp-svc 9000:80
Example starting point: https://github.com/dagster-io/dagster/tree/master/examples/assets_modern_data_stack
Depends on https://github.com/dagster-io/dagster/pull/10224