Chen, Junjie
Chen, Junjie
> Did I get it correctly? It only applies to position deletes? Correct. >My primary worry is that this would require a spec change and quite a bit of code...
> Are you referring to position deletes written to dedup changes within one batch? Right. > Btw, can you elaborate a bit on the issues you see w.r.t to conflicting...
> Flink upsert produces position files to dedup records within the same batch and those position deletes prevent from compaction, right? Right. > The issue is not related to concurrency,...
@Muyoo @zixi0825 , I guess you guys may be interested in this PR: https://github.com/apache/iceberg/pull/1423.
This solution is similar to my early PR(https://github.com/apache/iceberg/pull/4748, and https://github.com/apache/iceberg/pull/4703). This way is deemed as dangerous so I change to another way ( https://github.com/apache/iceberg/pull/5760)
+ @aokolnychyi @flyrain You guys may have interests as well.
>Flink delta txn won't commit pos deletes that can be applied to historical data. That is to say, there is no risk of ignoring pos deletes can be applied to...