Danny Chan

I guess the huge resource cost comes from the rewrite of the parquets, because each update touches almost all the file groups, it will trigger a whole table rewrite. If...

Is the OOM happening in Driver or executor? The driver could takes large amout of memory for the fs view file index, the solution to ease it to enable the...

Agree, maybe you can fire a fix for it, we can firstly deprecate it.

> PRIMARY KEY and PARTITIONED BY conflict with user configurations hoodie.datasource.write.recordkey.field and hoodie.datasource.write.partitionpath.field, the job does not throw an error. Instead, it prioritizes the Flink SQL keywords over the Hoodie...

> In this case, should we directly throw an error? Inform the user of the conflict and ask them to correct the configuration Maybe we just log some warnings there.