data-pipelines topic

Define sophisticated data pipelines with Python and run them on different distributed systems (such as Argo Workflows).

larribas

A lightweight CLI tool for versioning data alongside source code and building data pipelines.

kevin-hanselman

Build data pipelines, the easy way 🛠️

orchest

An orchestration platform for the development, production, and observation of data assets.

dagster-io

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

elementary-data

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

raystack

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

meltano

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

activeloopai

One framework to develop, deploy and operate data workflows with Python and SQL.

vmware

Dataform is a framework for managing SQL based data operations in BigQuery

dataform-co