streaming-at-scale
streaming-at-scale copied to clipboard
Update to Ingest Data into Delta Lake Using Azure Synapse
Modeled after the eventhubs-capture-databricks-delta
example, this update adds an end-to-end example to demonstrate ingesting and processing EventHub captured data into an Azure Storage Delta Lake using Azure Synapse as the processing layer.
Please refer to the README for more details on the solution and how to run the script.
I think the title of the PR should be changed. There doesn't seem to be such a thing as Azure storage Delta Lake. It's an implementation of Apache Delta Lake inside Azure Synapse. See https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-what-is-delta-lake.
Please reopen after addressing comments.