Vinish Reddy

[HUDI-7830] Add predicate filter pruning for snapshot queries in hudi related sources

1

### Change Logs Add new method getNextCheckpointWithPredicates in abstract class SnapshotLoadQuerySplitter for retrieving the next checkpoint along with file pruning predicates (partition filters etc.) for optimising snapshot query. These predicates...

XTable 1st Release

6

### Feature Request / Improvement Copying the email sent to [email protected] https://lists.apache.org/thread/kjwtg55rdcllvyol6sqszd6ozgto7z45 ``` [DISCUSS] Targeting July Release for Apache XTable (Incubating) Hi everyone, I hope this message finds you well....

### Feature Request / Improvement Suggestion from @jcamachor (This is not strictly about the release, but it's useful to address as we do housekeeping and establish processes.) Regarding branches, I...

## *Important Read* - *Please ensure the GitHub issue is mentioned at the beginning of the PR* ## What is the purpose of the pull request *(For example: This pull...

maven-javadoc-plugin fails to generate java docs for java version 1.8 when using apache parent pom version 33

1

Hey Apache Maven Team. We are seeing an issue in generating java docs when using the latest version (33) for apache parent pom. `mvn deploy -Prelease -DskipTests -DdeployArtifacts=true ` fails...

[HUDI-8126] Persist sourceRdd to optimise writeStatus DAG

1

### Change Logs Persist the sourceRDD in fetchNext method for optimising error table DAG. It helps in avoiding expensive source reads when writing to the error table. ### Impact Cuts...

[HUDI-8071] Handle skew for user defined sort columns in BULK_INSERT

1

### Change Logs If there is a skew in user defined columns for sortKey, spark sort reduces the number of tasks and this leads to an increase in contention when...

## *Important Read* - *Please ensure the GitHub issue is mentioned at the beginning of the PR* ## What is the purpose of the pull request Excludes xtable-utilities from release...

Design a system which consumes columnar file notifications from HDFS/cloud storage and generates delta, hudi and iceberg metadata

1

### Feature Request / Improvement Sub-task of main feature request https://github.com/apache/incubator-xtable/issues/550 Look at **Using cloud notifications queue** in the approach mentioned below. It's only a high level approach, with many...

### Feature Request / Improvement Sub-task of main feature request https://github.com/apache/incubator-xtable/issues/550 Look at **Using List files** in the approach mentioned below. It's only a high level approach, PR author can...