etl-pipeline topic

Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark

vsouza

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

maxim2266

Implementing best practices for PySpark ETL jobs and applications.

AlexIoannides

A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton

stitchfix

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

san089

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

san089

A simple Spark-powered ETL framework that just works 🍺

SETL-Framework

Watchmen Platform is a low code data platform for data pipeline, meta data management , analysis, and quality management

Indexical-Metrics-Measure-Advisory

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

apache

A simplified, lightweight ETL Framework based on Apache Spark

YotpoLtd