data-pipeline topic

A lightweight stream processing library for Go

reugn

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

apache

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

ConduitIO

Use SQL to build ELT pipelines on a data lakehouse.

cuebook

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collecti...

whylabs

Tools for ASR Corpus Generation from Online Video

yc9701

Example end to end data engineering project.

damklis

:mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

aeksco

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

AgnostiqHQ

Smarter data pipelines for audio.

spotify