Shawn Chang
Shawn Chang
### Change Logs 1. Have S3/GCSEvent source uses QueryContext instead 2. Remove QueryInfo ### Impact S3/GCS event source will use completion time as checkpoint ### Risk level (write none, low...
### Change Logs Since #12529 , `BaseCommitActionExecutor` would update col stats by default. But bootstrap operation doesn't support col stats and will fail the bootstraping - https://github.com/apache/hudi/blob/63362ad7b69d0bea50caceb1e744c53454a1cc23/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/bootstrap/SparkBootstrapCommitActionExecutor.java#L225 This PR is...
### Is your feature request related to a problem or challenge? To detect conflicts, we need to have `validate` and related logic to scan manifests and validate against history. References:...
### Is your feature request related to a problem or challenge? As we are close to support INSERT INTO for both partitioned/unpartitioned data (#1827 ). It makes sense to start...
We need to make fanout_enabled configurable via properties for datafusion write. When fanout_enabled is true, we use FanoutWriter, otherwise we use ClusteredWriter _Originally posted by @liurenjie1024 in https://github.com/apache/iceberg-rust/pull/1827#discussion_r2512430698_
### Is your feature request related to a problem or challenge? Now many APIs in `transaction/mod.rs` don't have an integration tests to test if they actually work after committing the...
## Which issue does this PR close? - Closes #1607 ## What changes are included in this PR? - Implemented `RewriteFilesAction` - Added `SnapshotValidator` and implemented it for `RewriteFilesOperation` -...
## Which issue does this PR close? - Closes #1314 ## What changes are included in this PR? ## Are these changes tested? Added some tests for the new storage...
### Is your feature request related to a problem or challenge? As a part of #1382 , we need to implement `insert_into` for `IcebergTableProvider` to support `INSERT INTO` query in...
### Is your feature request related to a problem or challenge? As mentioned here: https://github.com/apache/iceberg-rust/pull/1735#discussion_r2428605135 Currently `IcebergWriterBuilder`, `RollingFileWriterBuilder`, and `FileWriterBuilder` all have `build(self)` and will consume itself when building the...