deltalake topic

A highly efficient daemon for streaming data from Kafka into Delta Lake

delta-io

The Internals of Delta Lake

japila-books

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

izhangzhihao

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We wil...

martandsingh

Smart Automation Tool for building modern Data Lakes and Data Pipelines

smart-data-lake

Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.

WeBankFinTech

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POC...

databrickslabs

Databricks Platform - Architecture, Security, Automation and much more!!

bhavink

Open source stack lakehouse

leehuwuj

This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of the transaction log for the table.

anneglienke