data-ingestion topic

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

airbytehq

Use SQL to build ELT pipelines on a data lakehouse.

cuebook

Concurrent and multi-stage data ingestion and data processing with Elixir

dashbitco

Pravega - Streaming as a new software defined storage primitive

pravega

A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:

merantix-momentum

Apache Spark examples exclusively in Java

jgperrin

The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย

thedataengineeringbook

Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate

aws-samples

The Data Integration Library project provides a library of generic components based on a multi-stage architecture for data ingress and egress.

linkedin

Download and warehouse historical trading data

fremantle-industries