Danny Chan

Results 393 comments of Danny Chan

You need to check whether you have these missing classes in your bundle jar first.

There is a shade pattern for `com.google.common` package in the bundle jar pom.

> com.google.common be included in the hudi bundle package It should be, and it needs to be shaded with `org.apache.hudi` prefix.

Should be useful but it will be very related to specific use cases, I suggest we push-forward if we receive more feedbacks from community.

My speculation is that it is because of the false positive of bloom_filter index, while because you are still using 0.11 release, maybe you can try simple index instead.

There is a stage named like "buildPartitionProfile" which would take long time if the fp happens.

I see you put the option `options.put(FlinkOptions.IGNORE_FAILED.key(), "false");`, it looks like there is error for parquet writers which is collected back to the coordinator, so it reports error when committing.

> Changed the IGNORE_KEY to true and it seems to be working but I dont see any data in the parquet files. They are all empty. Any idea how should...