:sparkles: The present project is a basic process pipeline of extrating, transforming, loading, analysing and presenting. All of that was made by using suitable tools of web scraping, data analysis/pr...
(project & tutorial) dag pipeline tests + ci/cd setup
A list of useful resources to learn Data Engineering from scratch
A list about Apache Kafka
The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP
Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
Open-source data observability for analytics engineers.
task management & automation tool