cloud-composer topic

List cloud-composer repositories

public-datasets-pipelines

140
Stars
62
Forks
Watchers

Cloud-native, data onboarding architecture for Google Cloud Datasets

airflow-toolkit

107
Stars
32
Forks
Watchers

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) :desktop_computer: >> [ :rocket:, :ship:...

doit-composer-airflow-training

29
Stars
4
Forks
Watchers

Getting started with Apache Airflow on Cloud Composer

cloud-composer-mssql-dataflow-bigquery

16
Stars
13
Forks
Watchers

This repository contains an example of how to leverage Cloud Composer and Cloud Dataflow to move data from a Microsoft SQL Server to BigQuery. The diagrams below demonstrate the workflow pipeline.

This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering solution for processing, storing, and reporting daily transaction...