streaming-at-scale icon indicating copy to clipboard operation
streaming-at-scale copied to clipboard

Update to Ingest Data into Delta Lake Using Azure Synapse

Open kingfardthe1st opened this issue 2 years ago • 1 comments

Modeled after the eventhubs-capture-databricks-delta example, this update adds an end-to-end example to demonstrate ingesting and processing EventHub captured data into an Azure Storage Delta Lake using Azure Synapse as the processing layer.

Please refer to the README for more details on the solution and how to run the script.

kingfardthe1st avatar Jun 27 '22 19:06 kingfardthe1st

I think the title of the PR should be changed. There doesn't seem to be such a thing as Azure storage Delta Lake. It's an implementation of Apache Delta Lake inside Azure Synapse. See https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-what-is-delta-lake.

benjguin avatar Jun 30 '22 07:06 benjguin

Please reopen after addressing comments.

algattik avatar Jul 12 '23 08:07 algattik