etl topic

A Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database

palewire

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

maxim2266

Python ETL(Extract-Transform-Load) tool / Data migration tool

toaco

Implementing best practices for PySpark ETL jobs and applications.

AlexIoannides

An orchestration platform for the development, production, and observation of data assets.

dagster-io

The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.

onepanelio

A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton

stitchfix

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Go...

blockchain-etl

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

raystack

Fancy stream processing made operationally mundane

redpanda-data