datapipeline topic

List datapipeline repositories

zdh_web

422
Stars
159
Forks
Watchers

大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台,包含数据采集,调度,权限,审批流,私域营销等模块

TensorPipe

86
Stars
20
Forks
Watchers

High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.

kedro-action

20
Stars
3
Forks
Watchers

A GitHub Action to lint, test, build-docs, package, and run your kedro pipelines. Supports any Python version you'll give it (that is also supported by pyenv).

kedro-static-viz

27
Stars
2
Forks
Watchers

kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.

tf2-tutorial

51
Stars
9
Forks
Watchers

Tensorflow 2 Tutorials (use tensorflow and keras in a better way!)

sparkplug

28
Stars
2
Forks
Watchers

Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

terraform-aws-efs-backup

42
Stars
33
Forks
Watchers

Terraform module designed to easily backup EFS filesystems to S3 using DataPipeline

Snowflake-Json-DataPipeline

26
Stars
6
Forks
Watchers

Building Json data pipeline within Snowflake using Streams and Tasks