Validate parent snapshots in Kafka Connect
This change uses the new API in https://github.com/apache/iceberg/pull/14514 to validate that no concurrent commit has moved the Kafka offsets that would not be seen by the committer due to the table refreshing during the commit process.
It is an alternative solution to https://github.com/apache/iceberg/pull/14510.
@rdblue What do you think?
Thank you for the review @rdblue, I appreciate your feedback!
Given that https://github.com/apache/iceberg/pull/14509 has been merged, we should probably go ahead with that API.
I still think there's value in adding validateFromSnapshot(long snapshotId) to allow clients to limit the checked history. I can raise a separate PR for this feature.
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the [email protected] list. Thank you for your contributions.
This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.