Denny Lee
Denny Lee
This is the proposed Delta Lake 2022 H1 roadmap discussion thread. Below are the initially proposed items for the roadmap to be completed by June 2022. We will also be...
Build a Flink/Delta source (i.e., Flink reads from Delta Lake) potentially leveraging the [Delta Standalone Reader](https://github.com/delta-io/connectors#delta-standalone-reader). Expansion of issue #74 . ## PR Plan: - PR 5 - Option support...
# Description Just like the Python and Ruby bindings, it would be great if we could have Golang bindings. **Use Case** Allow clients use Golang to connect to Delta tables...
Per dependabot security issues, test and validate package updates
Per https://docs.snowflake.com/en/user-guide/tables-external-intro.html#delta-lake-support, add Snowflake external tables Delta Lake support to Integrations
To minimize receiving 429 errors when running Spark queries against Cosmos DB. ## Size Assumptions For this initial iteration, we will make the following assumptions. * X number of Spark...
Make better use of DocumentDB's native capabilities (e.g. aggregations, `ORDER BY`, `LIMIT`, etc.) so a more optimized dataset is returned to Apache Spark. For example: - For cumulative aggregations, DocumentDB...
Current design best practice involves 1:1 or 1:2 for Spark workers:DocumentDB data partitions. Need to update documentation to reflect this.
Create aggregations within structured streams with data being inserted into Cosmos DB.
Now that the structured stream code-base has been checked in, we should create samples denoting Cosmos DB change feed as a source and aggregating data.