data-orchestration topic

List data-orchestration repositories

cubefs

4.6k
Stars
657
Forks
Watchers

cloud-native distributed storage

kestra

11.9k
Stars
1.0k
Forks
163
Watchers

:zap: Workflow Automation Platform. Orchestrate & Schedule code in any language, run anywhere, 500+ plugins. Alternative to Zapier, Rundeck, Camunda, Airflow...

alluxio

6.7k
Stars
2.9k
Forks
Watchers

Alluxio, data orchestration for analytics and machine learning in the cloud

Skytrax-Data-Warehouse

132
Stars
26
Forks
Watchers

A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data vi...

btp-data-to-value-workshop

21
Stars
22
Forks
Watchers

This repo contains a dataset, exercises, and sample code for an end-to-end SAP BTP data-to-value bootcamp covering SAP HANA Cloud, SAP Data Warehouse Cloud, SAP Data Intelligence Cloud, and SAP Analyt...

incubator-graphar

183
Stars
41
Forks
Watchers

An open source, standard data file format for graph data storage and retrieval.

airflow-provider-fivetran-async

20
Stars
7
Forks
Watchers

A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran

data-engineering-mta-turnstile

22
Stars
3
Forks
Watchers

Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis

data-aware-orchestration

29
Stars
0
Forks
Watchers

Data-aware orchestration with dagster, dbt, and airbyte