hudi
hudi copied to clipboard
Upserts, Deletes And Incremental Processing on Big Data.
### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance impact._...
Hello Hudi, this is a question regarding the design considerations between metadata table (MDT) and the archiving commit action on a data table (DT). When performing archival of commits on...
### Change Logs 1. Remove marker delete code in `CompactionPlanOperator`, which could cause corrupted parquet files issue if compaction tasks were cancelled 2. Fix HUDI-4108 in another way, ignore the...
### Change Logs Implement consistent hashing bucket index for flink. This PR only covers the write core of the index, and the resizing implementation will be in another PR. There...
### Change Logs Currently, we have `FileSystemBasedLockProvier`, which relies on the atomic guarantee of the underlying file system. Specifically, only with filesystem's atomic rename & atomic create capability, the LockProvider...
* Hudi version : 0.11.1 * Spark version : 3.1.1 * Storage (HDFS/S3/GCS..) : S3 * Running on Docker? (yes/no) : no * Environment: Glue 3 Issue happen quite rarely...
hudi:0.10.1 spark:3.1.3_scala2.12 background story: I use SparkRDDWriteClient to process hudi , both app and spark standalone cluster are running in docker. When the app and spark cluster container running in...
## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request...
**_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at [email protected]. - If you...
**_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at [email protected]. - If you...