hudi
hudi copied to clipboard
apache
Upserts, Deletes And Incremental Processing on Big Data.
## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8690 - Type: Sub-task - Parent: https://issues.apache.org/jira/browse/HUDI-8875 - Fix version(s): - 1.1.0
## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8636 - Type: Sub-task - Parent: https://issues.apache.org/jira/browse/HUDI-9107 - Fix version(s): - 1.1.0
# Do we really need completely different relations based on checkpoint version.. I feel just passing in the checkpoint version to use is sufficient.. I worry there are too many...
## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8625 - Type: Sub-task - Parent: https://issues.apache.org/jira/browse/HUDI-9105 - Fix version(s): - 1.1.0
here is what a typical file group instantiation of MDT partition looks like t10: create a dummy commit w/ base commit time "0000000". So this will create a log file...
CustomKeyGenerator is not able to parse the microseconds part. Below is the reproducible code. In output its giving - "2023-03-04 14:44:42.046000" ``` fake = Faker() data = [{"ID": fake.uuid4(), "EventTime":...
Using this https://issues.apache.org/jira/browse/HUDI-8475, we plan to generate all stats within write handles. and https://issues.apache.org/jira/browse/HUDI-8474 is about designing a MDT re-partitioner. Except partition stats index, every other index should be straight...
Some tests in ITTestSavepointsCommand need to be re-written, since w/ MDT, we can't restore to arbitrary commits. a base file should be present before the commit being rolledback. but the...
Hi, I have discovered an issue that doesn't play nicely with the custom key generatosr, basically anything that is not TimestampBasedKeyGenerator or TimestampBasedAvroKeyGenerator. {{While trying to read a table that...
CDC doesn't support record merger, not on the read or write side. https://github.com/apache/hudi/pull/11943#discussion_r1809692780 ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8423 - Type: Sub-task - Parent: https://issues.apache.org/jira/browse/HUDI-9108 - Fix version(s): - 1.1.0