Danny Chan comments

Results 387 comments of


                                            Danny Chan

ADS layer malfunctioned. After restarting the job, the data statistics were incorrect

> One is that the new data overwrites the old data Not sure if you are using the `upsert` operation by using the index for updating. If you are using...

[SUPPORT] Data loss due to incorrect selection of log file during compaction

cc @nsivabalan for taking care of this issue~

[SUPPORT] Metadata table not cleaned / compacted, log files growing rapidly

Can you try this PR： https://github.com/apache/hudi/pull/8088

[SUPPORT] Metadata table not cleaned / compacted, log files growing rapidly

There might be no good solutions for 0..x release, recently we have merged a PR that address this issue on master branch: https://github.com/apache/hudi/pull/10874, it would be involved in 1.0.0 GA...

[SUPPORT] Metadata table not cleaned / compacted, log files growing rapidly

> 2a0969c9972ef746d377dbddd278ef13bf3d299d For mor table, it should be fine if it is the upsert semantics.

[SUPPORT] hudi0.14.0: Insert data into hudi with spark or create a new table exception

There might be mutiple spark-core jars on your classpath so that the belowing code snippet does not work well: ```java } else if (HoodieSparkUtils.isSpark3_0) { "org.apache.spark.sql.adapter.Spark3_0Adapter" } else { "org.apache.spark.sql.adapter.Spark2Adapter"...

[HUDI-7622] Optimize HoodieTableSource's sanity check

Thanks for the contribuiton, here is a patch for the fix: [7622.patch.zip](https://github.com/apache/hudi/files/15140670/7622.patch.zip) It would be greate if you can help to add some UTs.

[HUDI-7622] Optimize HoodieTableSource's sanity check

Close it because it is inactive.

[HUDI-7522] Support find out the conflict instants in bucket partition when bucket id multiple

@beyond1920 Can you help for the review?

[HUDI-7669] Move config classes and utils to proper places

> Moves ConfigProperty, EnumDescription, EnumFieldDescription, HoodieConfig, TypedProperties from hudi-common to hudi-io module so that classes in hudi-io and hudi-hadoop-common modules can use config-related logic It may solves the dependency issue,...