Gopi Krishna Madabhushi
Gopi Krishna Madabhushi
Extracts the column level stats from parquet file and add it to the delta log in json format, fixes https://github.com/delta-io/connectors/issues/371 - The implementation is not complete as it may not...
The implementation passes null for the stats field for AddFile action. Adding stats to the log would enable optimization of queries on the delta table as well as help upsert...
stats is a string field in AddFile. But while serializing it to the delta log, it's interpreted as json and serialized as object instead of string. But while deserialization, it...
Existing implementation supports appends only. This feature request is to support upserts in a delta table that is sorted by it's primary key columns. Here's a rough proposal of how...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Let's say we've an organization that deploys ballista cluster to which multiple...
**Required Functionality** Current implementation requires that the schemas be specified in json format. This is too verbose compared to yaml. **Proposed Solution** A simplest fix could be add an option...
Consider an asynchronous system with external queue from where requests are sent. The response to this request merely means an ack to the request and not the handling. The server...
This is an incomplete PR, only for initial feedback on approach. Close #423
Hi, I would recommend to do it via `.option(...)`. And the implementation for `.option(...`) for Delta Sink Builder in my opinion should be implemented in separate branch, reviewed and merged...