iceberg make Flink iceberg sink work without checkpoint enabled.

Current Flink Iceberg Sink depends on checkpoint to do commit. If we don't enable checkpoint, the data will not be commit into iceberg. so we have to do an improvement.

Sep 11 '20 08:09 simonsssu

relate to PR: [https://github.com/apache/iceberg/pull/1515]

Sep 27 '20 01:09 simonsssu

Hi @simonsssu , can you explain more about the user cases? Without checkpointing, it seems that consistency is not guaranteed at all. What are the disadvantages of opening checkpointing?

Sep 29 '20 05:09 JingsongLi

@JingsongLi In my use case, the input is a NATS stream which already supports durable and acknowledge mechanism, so I don't think I need checkpointing to guarantee consistency.

Also, opening checkpointing means another storage needed to store checkpoint files?

Aug 02 '23 13:08 vu-hoang-phan-form3

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

Feb 25 '24 00:02 github-actions[bot]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'

Mar 11 '24 00:03 github-actions[bot]