etl-job topic

List etl-job repositories

bulk-writer

237
Stars
37
Forks
Watchers

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

pyspark-example-project

1.5k
Stars
656
Forks
Watchers

Implementing best practices for PySpark ETL jobs and applications.

goodreads_etl_pipeline

1.2k
Stars
209
Forks
Watchers

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Etl.Net

625
Stars
88
Forks
Watchers

Mass processing data with a complete ETL for .net developers

terraform-aws-kinesis-firehose

25
Stars
22
Forks
Watchers

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

analyst

15
Stars
2
Forks
Watchers

A declarative, SQL-like DSL for data integration tasks.

terraform-aws-glue

19
Stars
27
Forks
Watchers

Terraform modules for provisioning and managing AWS Glue resources

pyspark-template

18
Stars
2
Forks
Watchers

A Python PySpark Projet with Poetry

DataModelling

24
Stars
2
Forks
Watchers

This repo will guide you step-by-step method to create star schema dimensional model.