hudi
hudi copied to clipboard
Upserts, Deletes And Incremental Processing on Big Data.
**Describe the problem you faced** upsert bukcet index failed Steps to reproduce the behavior: 1. Start Spark 2. Create a dataframe of one record 3. Use BUCKET SIMPLE index upsert...
### Change Logs This PR improves docs on DynamoDB-based lock provider to avoid confusion on setting the configs. ### Impact **Risk level: none** The website can be built and visualized...
## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request...
### Change Logs Fixing compatibility w/ Spark 3.2.2, by abstracting away instantiation of `ProjectionOverSchema` utility behind `SparkAdapter` ### Impact **Risk level: Low ### Contributor's checklist - [ ] Read through...
## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request...
### Change Logs Fixing flaky test by drastically reducing concurrency level (to avoid CI flakiness) ### Impact **Risk level: None ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)...
### Change Logs Supporting delete savepoint for MOR table ### Impact Users could delete unnecessary savepoints and unblock archival for MOR table. **Risk level: medium ** Extraneous savepoints could be...
currenttly, the metatable of hudi stored in files/ dir and col_stat/ dir by some file groups, all the records together. however, with the data size of table growth, the num...
updated s3n to s3a because s3n has been deprecated ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public...
### Change Logs Table configuration properties were not being validated in deltastreamer so changes to properties that shouldn't change were being allowed. To fix this, we now call the validator...