datapipeline topic
zdh_web
大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台,包含数据采集,调度,权限,审批流,私域营销等模块
TensorPipe
High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.
kedro-action
A GitHub Action to lint, test, build-docs, package, and run your kedro pipelines. Supports any Python version you'll give it (that is also supported by pyenv).
kedro-static-viz
kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.
tf2-tutorial
Tensorflow 2 Tutorials (use tensorflow and keras in a better way!)
sparkplug
Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
Data-Engineering-Roadmap
Roadmap for Data Engineering
awesome-data-pipeline
Awesome list for datapipeline
terraform-aws-efs-backup
Terraform module designed to easily backup EFS filesystems to S3 using DataPipeline
Snowflake-Json-DataPipeline
Building Json data pipeline within Snowflake using Streams and Tasks