[Subtask]: Store watermark in the snapshot level

Open wangtaohz opened this issue 2 years ago • 1 comments

Search before asking

[X] I have searched in the issues and found no similar issues.

Description

Currently, the watermark is stored in table properties, which makes it impossible to trace historical watermarks. We should store the watermark at the snapshot level, such as in the snapshot summary.

Parent issue

#1354

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Jul 20 '23 03:07 wangtaohz

I found iceberg 1.5.0 have watermark issues https://github.com/apache/iceberg/pull/8553 https://github.com/apache/iceberg/pull/9346,It's helpful for this issues? I want to understand and solve this problem @wangtaohz @zhoujinsong

Mar 23 '24 07:03 czy006

Closed as not planned.

Jun 25 '24 08:06 zhoujinsong